2026-03-30 05:30:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 05:30:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 05:30:05 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-30 05:30:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-30 05:30:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 05:30:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 05:30:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 05:30:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 05:30:05 [scrapy.extensions.telnet] INFO: Telnet Password: 33fc299f2c5a93b0
2026-03-30 05:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 05:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-30T05_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 05:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 05:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 05:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 05:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 05:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 05:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 05:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-30 05:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 05:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 05:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 05:30:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 05:30:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 05:30:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 05:30:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 05:30:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 05:30:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 05:30:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 05:30:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-30 05:30:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 05:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:30:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 05:30:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 05:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 05:30:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 05:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 05:30:27 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:27 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 05:30:27 [auto1.de] INFO: Scrape type for MU18409: 2
2026-03-30 05:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b386ae-293c-53d7-8ab2-662467cf717b with identifier: MU18409
2026-03-30 05:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b386ae-293c-53d7-8ab2-662467cf717b with scrape type 2
2026-03-30 05:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b386ae-293c-53d7-8ab2-662467cf717b with scrape type 2
2026-03-30 05:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72b386ae-293c-53d7-8ab2-662467cf717b, identifier: MU18409
2026-03-30 05:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72b386ae-293c-53d7-8ab2-662467cf717b with identifier: MU18409
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 05:30:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 05:30:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72b386ae-293c-53d7-8ab2-662467cf717b with identifier: MU18409
2026-03-30 05:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72b386ae-293c-53d7-8ab2-662467cf717b with identifier: MU18409 to the API
2026-03-30 05:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-31T15:23:03Z',
 'fuel_type': 'petrol',
 'id': '72b386ae-293c-53d7-8ab2-662467cf717b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU18409',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 62726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2021}
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 05:30:29 [auto1.de] INFO: Saving data for MU18409: {'auction_closing_time': 1774970583.0, 'created_time': 1774293772.506469, 'last_price_update_time': 1774848629.41283}
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU18409') HTTP/1.1" 204 0
2026-03-30 05:30:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:29 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 05:30:29 [auto1.de] INFO: Scrape type for AA81624: 2
2026-03-30 05:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-30 05:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99000bc0-5b18-595a-aa09-80e0730a8140 with scrape type 2
2026-03-30 05:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99000bc0-5b18-595a-aa09-80e0730a8140 with scrape type 2
2026-03-30 05:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99000bc0-5b18-595a-aa09-80e0730a8140, identifier: AA81624
2026-03-30 05:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 05:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624
2026-03-30 05:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99000bc0-5b18-595a-aa09-80e0730a8140 with identifier: AA81624 to the API
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:30:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'diesel',
 'id': '99000bc0-5b18-595a-aa09-80e0730a8140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA81624',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 107887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI extralang',
 'transmission': 'manual',
 'trim': 'extralang',
 'year': 2020}
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 05:30:30 [auto1.de] INFO: Saving data for AA81624: {'auction_closing_time': 1774882807.0, 'created_time': 1774550551.85758, 'last_price_update_time': 1774848630.111763}
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA81624') HTTP/1.1" 204 0
2026-03-30 05:30:30 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 05:30:30 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 05:30:30 [auto1.de] INFO: Scrape type for MV69505: 2
2026-03-30 05:30:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-30 05:30:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 2
2026-03-30 05:30:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7264d6f-1a5e-58d9-a331-975c677af46b with scrape type 2
2026-03-30 05:30:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7264d6f-1a5e-58d9-a331-975c677af46b, identifier: MV69505
2026-03-30 05:30:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 05:30:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:30:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505
2026-03-30 05:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7264d6f-1a5e-58d9-a331-975c677af46b with identifier: MV69505 to the API
2026-03-30 05:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:46Z',
 'fuel_type': 'diesel',
 'id': 'f7264d6f-1a5e-58d9-a331-975c677af46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV69505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 72898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Saving data for MV69505: {'auction_closing_time': 1774884886.0, 'created_time': 1774607623.476868, 'last_price_update_time': 1774848631.498074}
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV69505') HTTP/1.1" 204 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for GT74179: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for ZP13586: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for YW85241: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for UX63116: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for BX27275: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for XK12555: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for HM22337: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-30 05:30:31 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-30 05:30:31 [auto1.de] INFO: Scrape type for JM25076: 0
2026-03-30 05:30:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:30:32 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU18409%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for MU18409: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA81624%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for AA81624: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV69505%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for MV69505: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT74179%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for GT74179: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP13586%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for ZP13586: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01619%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for LT01619: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW85241%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for YW85241: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX63116%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for UX63116: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27275%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for BX27275: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK12555%27 HTTP/1.1" 200 None
2026-03-30 05:30:32 [auto1.de] INFO: Scrape type for XK12555: 0
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 05:30:32 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 05:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT99965%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for MT99965: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW74632%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for PW74632: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72449%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for ME72449: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR66468%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for KR66468: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT76020%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for RT76020: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA16616%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for SA16616: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN36676%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for HN36676: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX89684%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for BX89684: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM22337%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for HM22337: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP03054%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for MP03054: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF20752%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for PF20752: 0
2026-03-30 05:30:33 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM25076%27 HTTP/1.1" 200 None
2026-03-30 05:30:33 [auto1.de] INFO: Scrape type for JM25076: 0
2026-03-30 05:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:30:34 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD80802%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for HD80802: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70620%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for CR70620: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY87536%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for FY87536: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX43483%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for PX43483: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS38701%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for KS38701: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN64409%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for LN64409: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24074%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for UG24074: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE36292%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for RE36292: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA01516%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for ZA01516: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX65869%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for NX65869: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69588%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for EM69588: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA38840%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for RA38840: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES51146%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for ES51146: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC32924%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for RC32924: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN76849%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for XN76849: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF10018%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for XF10018: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ48176%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for TJ48176: 0
2026-03-30 05:30:34 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW07339%27 HTTP/1.1" 200 None
2026-03-30 05:30:34 [auto1.de] INFO: Scrape type for WW07339: 0
2026-03-30 05:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:30:45 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT08782%27 HTTP/1.1" 200 None
2026-03-30 05:30:45 [auto1.de] INFO: Scrape type for HT08782: 0
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH53806%27 HTTP/1.1" 200 None
2026-03-30 05:30:45 [auto1.de] INFO: Scrape type for UH53806: 0
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC28435%27 HTTP/1.1" 200 None
2026-03-30 05:30:45 [auto1.de] INFO: Scrape type for VC28435: 0
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT35568%27 HTTP/1.1" 200 None
2026-03-30 05:30:45 [auto1.de] INFO: Scrape type for GT35568: 0
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-30 05:30:45 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ90592%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for TJ90592: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV58900%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for CV58900: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG53469%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for RG53469: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT97457%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for AT97457: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS41181%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for DS41181: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY61426%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for WY61426: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV92050%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for BV92050: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL88623%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for UL88623: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW73502%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for NW73502: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV67523%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for BV67523: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01649%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for NW01649: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN44411%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for SN44411: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ40023%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for BJ40023: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR35896%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for VR35896: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG76921%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for CG76921: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14161%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for JT14161: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02803%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for WF02803: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN95655%27 HTTP/1.1" 200 None
2026-03-30 05:30:46 [auto1.de] INFO: Scrape type for LN95655: 0
2026-03-30 05:30:46 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-30 05:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:30:57 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP19661%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for HP19661: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA69463%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for FA69463: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG22836%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for WG22836: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27943%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for VF27943: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU72063%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for TU72063: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF05413%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for AF05413: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC94975%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for GC94975: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR75909%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for ZR75909: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW33550%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for YW33550: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT89872%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for RT89872: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN24673%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for VN24673: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY88037%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for ZY88037: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02702%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for AA02702: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG90894%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for KG90894: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41278%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for WX41278: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC66900%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for RC66900: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF58085%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for FF58085: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR94323%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for TR94323: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ33834%27 HTTP/1.1" 200 None
2026-03-30 05:30:57 [auto1.de] INFO: Scrape type for EJ33834: 0
2026-03-30 05:30:57 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-30 05:30:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:30:58 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6742 | hits on page: 40
2026-03-30 05:30:58 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-30 05:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN39592%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for FN39592: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV56430%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for YV56430: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV83737%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for VV83737: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC15325%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for EC15325: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL60563%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for TL60563: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW84981%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for XW84981: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE54390%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for XE54390: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: US93398
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US93398%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for US93398: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY12370%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for WY12370: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ19896%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for UJ19896: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN54864%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for LN54864: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL28977%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for ZL28977: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE29735%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for FE29735: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW55257%27 HTTP/1.1" 200 None
2026-03-30 05:30:59 [auto1.de] INFO: Scrape type for XW55257: 0
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-30 05:30:59 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 05:30:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:00 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48186%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for FG48186: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB77683%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for GB77683: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ39505%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for WZ39505: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL47006%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for YL47006: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97276%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for BT97276: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ62660%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for UJ62660: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY36184%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for UY36184: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA86799%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for XA86799: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU99742%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for SU99742: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE87532%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for ZE87532: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT45615%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for PT45615: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY35599%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for JY35599: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY67859%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for JY67859: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28932%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for SG28932: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG41395%27 HTTP/1.1" 200 None
2026-03-30 05:31:00 [auto1.de] INFO: Scrape type for MG41395: 0
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-30 05:31:00 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-30 05:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN18269%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for DN18269: 0
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK49951%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for WK49951: 0
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG95875%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for HG95875: 0
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV54413%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for SV54413: 0
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL13866%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for CL13866: 0
2026-03-30 05:31:01 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM17924%27 HTTP/1.1" 200 None
2026-03-30 05:31:01 [auto1.de] INFO: Scrape type for WM17924: 0
2026-03-30 05:31:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:02 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY81957%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for BY81957: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP55119%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for KP55119: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ51378%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for NJ51378: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF02627%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for CF02627: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM11182%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for DM11182: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX39495%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for EX39495: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR07934%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for GR07934: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY60106%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for LY60106: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ84157%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for GZ84157: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF75132%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for UF75132: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR75533%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for FR75533: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK64818%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for EK64818: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT28488%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for AT28488: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW90897%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for YW90897: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG12226%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for JG12226: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV43425%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for UV43425: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM39350%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for VM39350: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09643%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for CZ09643: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ98247%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for LZ98247: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV79824%27 HTTP/1.1" 200 None
2026-03-30 05:31:02 [auto1.de] INFO: Scrape type for LV79824: 0
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-30 05:31:02 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-30 05:31:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:03 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX49680%27 HTTP/1.1" 200 None
2026-03-30 05:31:03 [auto1.de] INFO: Scrape type for TX49680: 0
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW79047%27 HTTP/1.1" 200 None
2026-03-30 05:31:03 [auto1.de] INFO: Scrape type for MW79047: 0
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP29277%27 HTTP/1.1" 200 None
2026-03-30 05:31:03 [auto1.de] INFO: Scrape type for RP29277: 0
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX94865%27 HTTP/1.1" 200 None
2026-03-30 05:31:03 [auto1.de] INFO: Scrape type for VX94865: 0
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-30 05:31:03 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ47065%27 HTTP/1.1" 200 None
2026-03-30 05:31:03 [auto1.de] INFO: Scrape type for CZ47065: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE08723%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for XE08723: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU50389%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for AU50389: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ28184%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for KJ28184: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY43469%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for HY43469: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT98357%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for UT98357: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF75867%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for KF75867: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA01983%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for JA01983: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH44309%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for AH44309: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99817%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for PM99817: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB08314%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for DB08314: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP06637%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for DP06637: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG65344%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for NG65344: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT30705%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for XT30705: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD00479%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for AD00479: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL69426%27 HTTP/1.1" 200 None
2026-03-30 05:31:04 [auto1.de] INFO: Scrape type for CL69426: 0
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-30 05:31:04 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-30 05:31:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:06 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52801%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for WJ52801: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67741%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for GV67741: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR43778%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for SR43778: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF70516%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for PF70516: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY88868%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for YY88868: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU26057%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for EU26057: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ45087%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for RZ45087: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW35113%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for HW35113: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP80753%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for TP80753: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC78210%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for HC78210: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB48893%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for WB48893: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK03536%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for YK03536: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG12821%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for VG12821: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW56335%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for NW56335: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ19003%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for EJ19003: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL19889%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for EL19889: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL04777%27 HTTP/1.1" 200 None
2026-03-30 05:31:06 [auto1.de] INFO: Scrape type for XL04777: 0
2026-03-30 05:31:06 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-30 05:31:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:06 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 13 pages/min), scraped 3 items (at 3 items/min)
2026-03-30 05:31:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:31:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:08 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE60252%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for LE60252: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL18853%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for BL18853: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE49281%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for XE49281: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY67219%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for SY67219: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19475%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for NL19475: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ46196%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for WJ46196: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT70381%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for AT70381: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS26334%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for MS26334: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00957%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for HE00957: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ99813%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for PJ99813: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR95486%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for SR95486: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45010%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for WL45010: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ55974%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for VJ55974: 0
2026-03-30 05:31:08 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP11119%27 HTTP/1.1" 200 None
2026-03-30 05:31:08 [auto1.de] INFO: Scrape type for YP11119: 0
2026-03-30 05:31:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:09 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC32966%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for MC32966: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20654%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for FB20654: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA50226%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for FA50226: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY89352%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for SY89352: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE79096%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for YE79096: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG44569%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for XG44569: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE17704%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for EE17704: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT63610%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for WT63610: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD86800%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for GD86800: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90206%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for MT90206: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS19016%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for KS19016: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH98568%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for SH98568: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU56159%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for FU56159: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87515%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for HP87515: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE03726%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for VE03726: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC98877%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for VC98877: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ83553%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for SJ83553: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL55365%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for GL55365: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM39396%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for GM39396: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ57335%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for WJ57335: 0
2026-03-30 05:31:09 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU84960%27 HTTP/1.1" 200 None
2026-03-30 05:31:09 [auto1.de] INFO: Scrape type for YU84960: 0
2026-03-30 05:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:10 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT65336%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for JT65336: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK49782%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for HK49782: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR88683%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for BR88683: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY66131%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for PY66131: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL04579%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for AL04579: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH10753%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for NH10753: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA14151%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for CA14151: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF04397%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for EF04397: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP86111%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for PP86111: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99703%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for AU99703: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ07162%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for UJ07162: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL50945%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for HL50945: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE28257%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for JE28257: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK71200%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for TK71200: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ46252%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for EZ46252: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ45397%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for XJ45397: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN40523%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for DN40523: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR32079%27 HTTP/1.1" 200 None
2026-03-30 05:31:10 [auto1.de] INFO: Scrape type for NR32079: 0
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-30 05:31:10 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-30 05:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:12 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ01520%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for GZ01520: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD79431%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for PD79431: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS30445%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for RS30445: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN22748%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for VN22748: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK28670%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for BK28670: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB02108%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for TB02108: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK90767%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for AK90767: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC23372%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for YC23372: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27698%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for GB27698: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA11944%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for WA11944: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA77092%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for VA77092: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW90225%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for LW90225: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA27483%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for ZA27483: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM73112%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for XM73112: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS83117%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for HS83117: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP66782%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for RP66782: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW76455%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for RW76455: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL48750%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for VL48750: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29911%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for RC29911: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC25701%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for WC25701: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS41901%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for RS41901: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW57830%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for CW57830: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC02535%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for YC02535: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW01944%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for TW01944: 0
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 05:31:12 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT70874%27 HTTP/1.1" 200 None
2026-03-30 05:31:12 [auto1.de] INFO: Scrape type for HT70874: 0
2026-03-30 05:31:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:14 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF64937%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for KF64937: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW48128%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for XW48128: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19595%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for KL19595: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS77403%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for WS77403: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT87510%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for LT87510: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV77496%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for YV77496: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55946%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for UP55946: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ52204%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for NJ52204: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG08693%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for CG08693: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN38539%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for YN38539: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG10256%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for LG10256: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK73289%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for KK73289: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49952%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for LS49952: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN74445%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for EN74445: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC06801%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for NC06801: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL95361%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for YL95361: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ61875%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for DZ61875: 0
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 05:31:14 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF55933%27 HTTP/1.1" 200 None
2026-03-30 05:31:14 [auto1.de] INFO: Scrape type for SF55933: 0
2026-03-30 05:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:15 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY86630%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for RY86630: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU91826%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for CU91826: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY17846%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for YY17846: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG73719%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for CG73719: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB79280%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for NB79280: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK62781%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for XK62781: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF68653%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for YF68653: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF22102%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for TF22102: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94497%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for FG94497: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE99483%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for HE99483: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF77567%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for LF77567: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ93938%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for VJ93938: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX13429%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for AX13429: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD17030%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for SD17030: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81971%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for NH81971: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF12446%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for JF12446: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU44230%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for PU44230: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER86835%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for ER86835: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20018%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for MA20018: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU19428%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for SU19428: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW74525%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for UW74525: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06642%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for CP06642: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX40073%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for YX40073: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC05735%27 HTTP/1.1" 200 None
2026-03-30 05:31:15 [auto1.de] INFO: Scrape type for LC05735: 0
2026-03-30 05:31:15 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-30 05:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH46900%27 HTTP/1.1" 200 None
2026-03-30 05:31:16 [auto1.de] INFO: Scrape type for VH46900: 0
2026-03-30 05:31:16 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-30 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78793%27 HTTP/1.1" 200 None
2026-03-30 05:31:16 [auto1.de] INFO: Scrape type for FM78793: 0
2026-03-30 05:31:16 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-30 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW14620%27 HTTP/1.1" 200 None
2026-03-30 05:31:16 [auto1.de] INFO: Scrape type for AW14620: 0
2026-03-30 05:31:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:17 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN75041%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for ZN75041: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW93361%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for UW93361: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00897%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for YY00897: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE21080%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for DE21080: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP65093%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for ZP65093: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN49232%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for JN49232: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT07846%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for ZT07846: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG75781%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for WG75781: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR25455%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for ZR25455: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT54057%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for LT54057: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY54552%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for VY54552: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ78269%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for GJ78269: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW71141%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for HW71141: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM69554%27 HTTP/1.1" 200 None
2026-03-30 05:31:17 [auto1.de] INFO: Scrape type for EM69554: 0
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 05:31:17 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 05:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU39655%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for EU39655: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72867%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for RV72867: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX59054%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for TX59054: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT69734%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for XT69734: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP89204%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for UP89204: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ11746%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for TZ11746: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF01324%27 HTTP/1.1" 200 None
2026-03-30 05:31:18 [auto1.de] INFO: Scrape type for XF01324: 0
2026-03-30 05:31:18 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-30 05:31:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:19 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK08136%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for ZK08136: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS05622%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for VS05622: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU27746%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for CU27746: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN73859%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for UN73859: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22194%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for VG22194: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT90882%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for JT90882: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ18698%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for AJ18698: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68218%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for AG68218: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ27957%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for YZ27957: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA63896%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for GA63896: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19468%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for YP19468: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ51315%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for NZ51315: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH44928%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for VH44928: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28645%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for WC28645: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11604%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for LN11604: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR19518%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for XR19518: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE98948%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for FE98948: 0
2026-03-30 05:31:19 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT84792%27 HTTP/1.1" 200 None
2026-03-30 05:31:19 [auto1.de] INFO: Scrape type for GT84792: 0
2026-03-30 05:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:21 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS84935%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for GS84935: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK22592%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for UK22592: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU28651%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for FU28651: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY36946%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for GY36946: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV67596%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for PV67596: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET29931%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for ET29931: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP04527%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for BP04527: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW13353%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for PW13353: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG07802%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for JG07802: 0
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for RC29433: 2
2026-03-30 05:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888bb072-3727-51ae-a947-0a3ff3542d6f with identifier: RC29433
2026-03-30 05:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888bb072-3727-51ae-a947-0a3ff3542d6f with scrape type 2
2026-03-30 05:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 888bb072-3727-51ae-a947-0a3ff3542d6f with scrape type 2
2026-03-30 05:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 888bb072-3727-51ae-a947-0a3ff3542d6f, identifier: RC29433
2026-03-30 05:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 888bb072-3727-51ae-a947-0a3ff3542d6f with identifier: RC29433
2026-03-30 05:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 888bb072-3727-51ae-a947-0a3ff3542d6f with identifier: RC29433
2026-03-30 05:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 888bb072-3727-51ae-a947-0a3ff3542d6f with identifier: RC29433 to the API
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:48Z',
 'fuel_type': 'diesel',
 'id': '888bb072-3727-51ae-a947-0a3ff3542d6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC29433',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 53547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-27',
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 35 L4H2 Control Heavy Start&Stop',
 'transmission': 'manual',
 'trim': '35 L4H2 Control Heavy Start&Stop',
 'year': 2024}
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC29433%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Saving data for RC29433: {'auction_closing_time': 1774885668.0, 'created_time': 1774291366.670041, 'last_price_update_time': 1774848681.731244}
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC29433') HTTP/1.1" 204 0
2026-03-30 05:31:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-30 05:31:21 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-30 05:31:21 [auto1.de] INFO: Scrape type for YE68062: 2
2026-03-30 05:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with identifier: YE68062
2026-03-30 05:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with scrape type 2
2026-03-30 05:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with scrape type 2
2026-03-30 05:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1866d6a-a015-5ec8-bdd8-454b6cf0d441, identifier: YE68062
2026-03-30 05:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with identifier: YE68062
2026-03-30 05:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 05:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 05:31:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with identifier: YE68062
2026-03-30 05:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1866d6a-a015-5ec8-bdd8-454b6cf0d441 with identifier: YE68062 to the API
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 341,
 'expiration_date': '2026-03-30T15:00:21Z',
 'fuel_type': 'hybrid',
 'id': 'b1866d6a-a015-5ec8-bdd8-454b6cf0d441',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE68062',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 92020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-04',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T6 Plug-in Hybrid R Design Expression AWD',
 'transmission': 'automatic',
 'trim': 'R Design Expression AWD',
 'year': 2021}
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE68062%27 HTTP/1.1" 200 None
2026-03-30 05:31:22 [auto1.de] INFO: Saving data for YE68062: {'auction_closing_time': 1774882821.0, 'created_time': 1774034219.426483, 'last_price_update_time': 1774848682.486351}
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE68062') HTTP/1.1" 204 0
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-30 05:31:22 [auto1.de] INFO: Scrape type for FV18032: 2
2026-03-30 05:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6639b325-98b7-5df2-92fa-b436f697af79 with identifier: FV18032
2026-03-30 05:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6639b325-98b7-5df2-92fa-b436f697af79 with scrape type 2
2026-03-30 05:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6639b325-98b7-5df2-92fa-b436f697af79 with scrape type 2
2026-03-30 05:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6639b325-98b7-5df2-92fa-b436f697af79, identifier: FV18032
2026-03-30 05:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6639b325-98b7-5df2-92fa-b436f697af79 with identifier: FV18032
2026-03-30 05:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6639b325-98b7-5df2-92fa-b436f697af79 with identifier: FV18032
2026-03-30 05:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6639b325-98b7-5df2-92fa-b436f697af79 with identifier: FV18032 to the API
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:37:54Z',
 'fuel_type': 'hybrid',
 'id': '6639b325-98b7-5df2-92fa-b436f697af79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV18032',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 97118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-01',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Recharge Plug-in Hybrid Plus Bright AWD',
 'transmission': 'automatic',
 'trim': 'Plus Bright AWD',
 'year': 2022}
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV18032%27 HTTP/1.1" 200 None
2026-03-30 05:31:22 [auto1.de] INFO: Saving data for FV18032: {'auction_closing_time': 1774885074.0, 'created_time': 1774034357.716632, 'last_price_update_time': 1774848682.893719}
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV18032') HTTP/1.1" 204 0
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-30 05:31:22 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-30 05:31:22 [auto1.de] INFO: Scrape type for JA02220: 2
2026-03-30 05:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d27babb0-b8f9-50c2-9912-8cf7801f7a73 with identifier: JA02220
2026-03-30 05:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d27babb0-b8f9-50c2-9912-8cf7801f7a73 with scrape type 2
2026-03-30 05:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d27babb0-b8f9-50c2-9912-8cf7801f7a73 with scrape type 2
2026-03-30 05:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d27babb0-b8f9-50c2-9912-8cf7801f7a73, identifier: JA02220
2026-03-30 05:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d27babb0-b8f9-50c2-9912-8cf7801f7a73 with identifier: JA02220
2026-03-30 05:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d27babb0-b8f9-50c2-9912-8cf7801f7a73 with identifier: JA02220
2026-03-30 05:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d27babb0-b8f9-50c2-9912-8cf7801f7a73 with identifier: JA02220 to the API
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:10:46Z',
 'fuel_type': 'petrol',
 'id': 'd27babb0-b8f9-50c2-9912-8cf7801f7a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA02220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 112856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-06',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA02220%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Saving data for JA02220: {'auction_closing_time': 1774883446.0, 'created_time': 1774639355.433873, 'last_price_update_time': 1774848683.289407}
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA02220') HTTP/1.1" 204 0
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN21638%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Scrape type for JN21638: 0
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Scrape type for MA84823: 2
2026-03-30 05:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ef8086-e2a8-504e-831f-943b888b5e0c with identifier: MA84823
2026-03-30 05:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ef8086-e2a8-504e-831f-943b888b5e0c with scrape type 2
2026-03-30 05:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ef8086-e2a8-504e-831f-943b888b5e0c with scrape type 2
2026-03-30 05:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ef8086-e2a8-504e-831f-943b888b5e0c, identifier: MA84823
2026-03-30 05:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ef8086-e2a8-504e-831f-943b888b5e0c with identifier: MA84823
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 05:31:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ef8086-e2a8-504e-831f-943b888b5e0c with identifier: MA84823
2026-03-30 05:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ef8086-e2a8-504e-831f-943b888b5e0c with identifier: MA84823 to the API
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:17:15Z',
 'fuel_type': 'diesel',
 'id': 'b6ef8086-e2a8-504e-831f-943b888b5e0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA84823',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 122321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2023}
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA84823%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Saving data for MA84823: {'auction_closing_time': 1774883835.0, 'created_time': 1774435758.881487, 'last_price_update_time': 1774848683.832889}
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA84823') HTTP/1.1" 204 0
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30127%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Scrape type for MN30127: 0
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 05:31:23 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-30 05:31:23 [auto1.de] INFO: Scrape type for AY52280: 2
2026-03-30 05:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41748e17-b5cb-5d5e-acb3-93021ecaa28b with identifier: AY52280
2026-03-30 05:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41748e17-b5cb-5d5e-acb3-93021ecaa28b with scrape type 2
2026-03-30 05:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41748e17-b5cb-5d5e-acb3-93021ecaa28b with scrape type 2
2026-03-30 05:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41748e17-b5cb-5d5e-acb3-93021ecaa28b, identifier: AY52280
2026-03-30 05:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41748e17-b5cb-5d5e-acb3-93021ecaa28b with identifier: AY52280
2026-03-30 05:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41748e17-b5cb-5d5e-acb3-93021ecaa28b with identifier: AY52280
2026-03-30 05:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41748e17-b5cb-5d5e-acb3-93021ecaa28b with identifier: AY52280 to the API
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:34:43Z',
 'fuel_type': 'petrol',
 'id': '41748e17-b5cb-5d5e-acb3-93021ecaa28b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY52280',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 98499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-16',
 'seller_name': None,
 'title': 'Volkswagen Golf V 2.0 TFSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2008}
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY52280%27 HTTP/1.1" 200 None
2026-03-30 05:31:24 [auto1.de] INFO: Saving data for AY52280: {'auction_closing_time': 1774884883.0, 'created_time': 1774349830.234765, 'last_price_update_time': 1774848684.353786}
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY52280') HTTP/1.1" 204 0
2026-03-30 05:31:24 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 05:31:24 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-30 05:31:24 [auto1.de] INFO: Scrape type for EY37424: 2
2026-03-30 05:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a55cb0c-b029-50b6-93ec-de84803a28a2 with identifier: EY37424
2026-03-30 05:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a55cb0c-b029-50b6-93ec-de84803a28a2 with scrape type 2
2026-03-30 05:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a55cb0c-b029-50b6-93ec-de84803a28a2 with scrape type 2
2026-03-30 05:31:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a55cb0c-b029-50b6-93ec-de84803a28a2, identifier: EY37424
2026-03-30 05:31:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a55cb0c-b029-50b6-93ec-de84803a28a2 with identifier: EY37424
2026-03-30 05:31:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a55cb0c-b029-50b6-93ec-de84803a28a2 with identifier: EY37424
2026-03-30 05:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a55cb0c-b029-50b6-93ec-de84803a28a2 with identifier: EY37424 to the API
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:10Z',
 'fuel_type': 'petrol',
 'id': '2a55cb0c-b029-50b6-93ec-de84803a28a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY37424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 39016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-26',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2013}
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY37424%27 HTTP/1.1" 200 None
2026-03-30 05:31:24 [auto1.de] INFO: Saving data for EY37424: {'auction_closing_time': 1774883290.0, 'created_time': 1773399792.989294, 'last_price_update_time': 1774848684.770976}
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY37424') HTTP/1.1" 204 0
2026-03-30 05:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:24 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:24 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-30 05:31:24 [auto1.de] INFO: Scrape type for MT94431: 2
2026-03-30 05:31:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with identifier: MT94431
2026-03-30 05:31:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with scrape type 2
2026-03-30 05:31:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with scrape type 2
2026-03-30 05:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34a8cc78-f78d-5d75-95d9-6698d5feaa85, identifier: MT94431
2026-03-30 05:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with identifier: MT94431
2026-03-30 05:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with identifier: MT94431
2026-03-30 05:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34a8cc78-f78d-5d75-95d9-6698d5feaa85 with identifier: MT94431 to the API
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '34a8cc78-f78d-5d75-95d9-6698d5feaa85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT94431',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 73133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'manual',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2017}
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT94431%27 HTTP/1.1" 200 None
2026-03-30 05:31:25 [auto1.de] INFO: Saving data for MT94431: {'auction_closing_time': 1774884146.0, 'created_time': 1773468724.492547, 'last_price_update_time': 1774848685.297553}
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT94431') HTTP/1.1" 204 0
2026-03-30 05:31:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:25 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 05:31:25 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-30 05:31:25 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-30 05:31:25 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-30 05:31:25 [auto1.de] INFO: Scrape type for PS96844: 2
2026-03-30 05:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with identifier: PS96844
2026-03-30 05:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with scrape type 2
2026-03-30 05:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with scrape type 2
2026-03-30 05:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0290ede0-8b58-5325-b5f2-62f7b58bedd5, identifier: PS96844
2026-03-30 05:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with identifier: PS96844
2026-03-30 05:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with identifier: PS96844
2026-03-30 05:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0290ede0-8b58-5325-b5f2-62f7b58bedd5 with identifier: PS96844 to the API
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:57:46Z',
 'fuel_type': 'diesel',
 'id': '0290ede0-8b58-5325-b5f2-62f7b58bedd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS96844',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 210908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96844%27 HTTP/1.1" 200 None
2026-03-30 05:31:25 [auto1.de] INFO: Saving data for PS96844: {'auction_closing_time': 1774886266.0, 'created_time': 1773467151.810663, 'last_price_update_time': 1774848685.693089}
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS96844') HTTP/1.1" 204 0
2026-03-30 05:31:25 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-30 05:31:25 [auto1.de] INFO: Scrape type for DH90644: 2
2026-03-30 05:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with identifier: DH90644
2026-03-30 05:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with scrape type 2
2026-03-30 05:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with scrape type 2
2026-03-30 05:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0a02ff9-d1b3-544c-8de0-cedfd8eadf42, identifier: DH90644
2026-03-30 05:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with identifier: DH90644
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 05:31:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with identifier: DH90644
2026-03-30 05:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0a02ff9-d1b3-544c-8de0-cedfd8eadf42 with identifier: DH90644 to the API
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:35Z',
 'fuel_type': 'diesel',
 'id': 'e0a02ff9-d1b3-544c-8de0-cedfd8eadf42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH90644',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 208141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH90644%27 HTTP/1.1" 200 None
2026-03-30 05:31:26 [auto1.de] INFO: Saving data for DH90644: {'auction_closing_time': 1774883315.0, 'created_time': 1774762236.090426, 'last_price_update_time': 1774848686.342683}
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH90644') HTTP/1.1" 204 0
2026-03-30 05:31:26 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 05:31:26 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 05:31:26 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-30 05:31:26 [auto1.de] INFO: Scrape type for JX17903: 2
2026-03-30 05:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d12bf05-9540-5ecc-9408-f88a9597918b with identifier: JX17903
2026-03-30 05:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d12bf05-9540-5ecc-9408-f88a9597918b with scrape type 2
2026-03-30 05:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d12bf05-9540-5ecc-9408-f88a9597918b with scrape type 2
2026-03-30 05:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d12bf05-9540-5ecc-9408-f88a9597918b, identifier: JX17903
2026-03-30 05:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d12bf05-9540-5ecc-9408-f88a9597918b with identifier: JX17903
2026-03-30 05:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d12bf05-9540-5ecc-9408-f88a9597918b with identifier: JX17903
2026-03-30 05:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d12bf05-9540-5ecc-9408-f88a9597918b with identifier: JX17903 to the API
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:35:54Z',
 'fuel_type': 'petrol',
 'id': '3d12bf05-9540-5ecc-9408-f88a9597918b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX17903',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 9343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-06',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17903%27 HTTP/1.1" 200 None
2026-03-30 05:31:26 [auto1.de] INFO: Saving data for JX17903: {'auction_closing_time': 1774884954.0, 'created_time': 1774349353.081372, 'last_price_update_time': 1774848686.736589}
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX17903') HTTP/1.1" 204 0
2026-03-30 05:31:26 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-30 05:31:26 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-30 05:31:26 [auto1.de] INFO: Scrape type for NX25429: 2
2026-03-30 05:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca12ef2-85d2-590f-943c-35dafdaea7cb with identifier: NX25429
2026-03-30 05:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca12ef2-85d2-590f-943c-35dafdaea7cb with scrape type 2
2026-03-30 05:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ca12ef2-85d2-590f-943c-35dafdaea7cb with scrape type 2
2026-03-30 05:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ca12ef2-85d2-590f-943c-35dafdaea7cb, identifier: NX25429
2026-03-30 05:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ca12ef2-85d2-590f-943c-35dafdaea7cb with identifier: NX25429
2026-03-30 05:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ca12ef2-85d2-590f-943c-35dafdaea7cb with identifier: NX25429
2026-03-30 05:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ca12ef2-85d2-590f-943c-35dafdaea7cb with identifier: NX25429 to the API
2026-03-30 05:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:17:24Z',
 'fuel_type': 'petrol',
 'id': '4ca12ef2-85d2-590f-943c-35dafdaea7cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX25429',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 247992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX25429%27 HTTP/1.1" 200 None
2026-03-30 05:31:27 [auto1.de] INFO: Saving data for NX25429: {'auction_closing_time': 1774883844.0, 'created_time': 1774762237.870505, 'last_price_update_time': 1774848687.149566}
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX25429') HTTP/1.1" 204 0
2026-03-30 05:31:27 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-30 05:31:27 [auto1.de] INFO: Scrape type for FB30616: 2
2026-03-30 05:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c1e51b-f4e7-5578-94a4-6d5657021c16 with identifier: FB30616
2026-03-30 05:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c1e51b-f4e7-5578-94a4-6d5657021c16 with scrape type 2
2026-03-30 05:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c1e51b-f4e7-5578-94a4-6d5657021c16 with scrape type 2
2026-03-30 05:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c1e51b-f4e7-5578-94a4-6d5657021c16, identifier: FB30616
2026-03-30 05:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c1e51b-f4e7-5578-94a4-6d5657021c16 with identifier: FB30616
2026-03-30 05:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c1e51b-f4e7-5578-94a4-6d5657021c16 with identifier: FB30616
2026-03-30 05:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c1e51b-f4e7-5578-94a4-6d5657021c16 with identifier: FB30616 to the API
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:28:11Z',
 'fuel_type': 'petrol',
 'id': '80c1e51b-f4e7-5578-94a4-6d5657021c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB30616',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 19957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-11',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.4 TSI Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2014}
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB30616%27 HTTP/1.1" 200 None
2026-03-30 05:31:27 [auto1.de] INFO: Saving data for FB30616: {'auction_closing_time': 1774884491.0, 'created_time': 1773468077.823933, 'last_price_update_time': 1774848687.569382}
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB30616') HTTP/1.1" 204 0
2026-03-30 05:31:27 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-30 05:31:27 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-30 05:31:27 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-30 05:31:27 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-30 05:31:27 [auto1.de] INFO: Scrape type for EM09444: 2
2026-03-30 05:31:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f747b1-bb6d-569e-b228-b0719878d2b9 with identifier: EM09444
2026-03-30 05:31:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f747b1-bb6d-569e-b228-b0719878d2b9 with scrape type 2
2026-03-30 05:31:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f747b1-bb6d-569e-b228-b0719878d2b9 with scrape type 2
2026-03-30 05:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f747b1-bb6d-569e-b228-b0719878d2b9, identifier: EM09444
2026-03-30 05:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f747b1-bb6d-569e-b228-b0719878d2b9 with identifier: EM09444
2026-03-30 05:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f747b1-bb6d-569e-b228-b0719878d2b9 with identifier: EM09444
2026-03-30 05:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f747b1-bb6d-569e-b228-b0719878d2b9 with identifier: EM09444 to the API
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:30:33Z',
 'fuel_type': 'petrol',
 'id': '55f747b1-bb6d-569e-b228-b0719878d2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM09444',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 75439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-27',
 'seller_name': None,
 'title': 'MINI Clubman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09444%27 HTTP/1.1" 200 None
2026-03-30 05:31:28 [auto1.de] INFO: Saving data for EM09444: {'auction_closing_time': 1774884633.0, 'created_time': 1773399039.209565, 'last_price_update_time': 1774848688.045638}
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM09444') HTTP/1.1" 204 0
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-30 05:31:28 [auto1.de] INFO: Scrape type for KJ73179: 2
2026-03-30 05:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78aba021-8f53-55ed-9890-8ef0ad83c279 with identifier: KJ73179
2026-03-30 05:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78aba021-8f53-55ed-9890-8ef0ad83c279 with scrape type 2
2026-03-30 05:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78aba021-8f53-55ed-9890-8ef0ad83c279 with scrape type 2
2026-03-30 05:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78aba021-8f53-55ed-9890-8ef0ad83c279, identifier: KJ73179
2026-03-30 05:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78aba021-8f53-55ed-9890-8ef0ad83c279 with identifier: KJ73179
2026-03-30 05:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78aba021-8f53-55ed-9890-8ef0ad83c279 with identifier: KJ73179
2026-03-30 05:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78aba021-8f53-55ed-9890-8ef0ad83c279 with identifier: KJ73179 to the API
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:22:21Z',
 'fuel_type': 'diesel',
 'id': '78aba021-8f53-55ed-9890-8ef0ad83c279',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ73179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 207164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ73179%27 HTTP/1.1" 200 None
2026-03-30 05:31:28 [auto1.de] INFO: Saving data for KJ73179: {'auction_closing_time': 1774884141.0, 'created_time': 1774118419.878137, 'last_price_update_time': 1774848688.591269}
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ73179') HTTP/1.1" 204 0
2026-03-30 05:31:28 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-30 05:31:28 [auto1.de] INFO: Scrape type for VM07579: 2
2026-03-30 05:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdc32fcf-602b-5670-9414-cfcd36392939 with identifier: VM07579
2026-03-30 05:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdc32fcf-602b-5670-9414-cfcd36392939 with scrape type 2
2026-03-30 05:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdc32fcf-602b-5670-9414-cfcd36392939 with scrape type 2
2026-03-30 05:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdc32fcf-602b-5670-9414-cfcd36392939, identifier: VM07579
2026-03-30 05:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdc32fcf-602b-5670-9414-cfcd36392939 with identifier: VM07579
2026-03-30 05:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdc32fcf-602b-5670-9414-cfcd36392939 with identifier: VM07579
2026-03-30 05:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdc32fcf-602b-5670-9414-cfcd36392939 with identifier: VM07579 to the API
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:29:37Z',
 'fuel_type': 'petrol',
 'id': 'cdc32fcf-602b-5670-9414-cfcd36392939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM07579',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 167194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM07579%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Saving data for VM07579: {'auction_closing_time': 1774884577.0, 'created_time': 1773399870.130429, 'last_price_update_time': 1774848689.037428}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM07579') HTTP/1.1" 204 0
2026-03-30 05:31:29 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH18940%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Scrape type for XH18940: 0
2026-03-30 05:31:29 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Scrape type for UZ89172: 2
2026-03-30 05:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff76569-66ec-5d4c-ab05-c6643bee7b04 with identifier: UZ89172
2026-03-30 05:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff76569-66ec-5d4c-ab05-c6643bee7b04 with scrape type 2
2026-03-30 05:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fff76569-66ec-5d4c-ab05-c6643bee7b04 with scrape type 2
2026-03-30 05:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fff76569-66ec-5d4c-ab05-c6643bee7b04, identifier: UZ89172
2026-03-30 05:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fff76569-66ec-5d4c-ab05-c6643bee7b04 with identifier: UZ89172
2026-03-30 05:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fff76569-66ec-5d4c-ab05-c6643bee7b04 with identifier: UZ89172
2026-03-30 05:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fff76569-66ec-5d4c-ab05-c6643bee7b04 with identifier: UZ89172 to the API
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:01:44Z',
 'fuel_type': 'petrol',
 'id': 'fff76569-66ec-5d4c-ab05-c6643bee7b04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ89172',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 88336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2009}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ89172%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Saving data for UZ89172: {'auction_closing_time': 1774882904.0, 'created_time': 1774762241.282272, 'last_price_update_time': 1774848689.509971}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ89172') HTTP/1.1" 204 0
2026-03-30 05:31:29 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Scrape type for EF06925: 2
2026-03-30 05:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with identifier: EF06925
2026-03-30 05:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with scrape type 2
2026-03-30 05:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with scrape type 2
2026-03-30 05:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c099474-bc5f-5968-92c9-7fdfb97dfa02, identifier: EF06925
2026-03-30 05:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with identifier: EF06925
2026-03-30 05:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with identifier: EF06925
2026-03-30 05:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c099474-bc5f-5968-92c9-7fdfb97dfa02 with identifier: EF06925 to the API
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:50:21Z',
 'fuel_type': 'diesel',
 'id': '4c099474-bc5f-5968-92c9-7fdfb97dfa02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF06925',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 317360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF06925%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Saving data for EF06925: {'auction_closing_time': 1774885821.0, 'created_time': 1773399503.920377, 'last_price_update_time': 1774848689.951073}
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF06925') HTTP/1.1" 204 0
2026-03-30 05:31:29 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:29 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-30 05:31:29 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-30 05:31:29 [auto1.de] INFO: Scrape type for UE56505: 2
2026-03-30 05:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36dea350-3af6-5adb-90d7-60ffa6ece543 with identifier: UE56505
2026-03-30 05:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36dea350-3af6-5adb-90d7-60ffa6ece543 with scrape type 2
2026-03-30 05:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36dea350-3af6-5adb-90d7-60ffa6ece543 with scrape type 2
2026-03-30 05:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36dea350-3af6-5adb-90d7-60ffa6ece543, identifier: UE56505
2026-03-30 05:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36dea350-3af6-5adb-90d7-60ffa6ece543 with identifier: UE56505
2026-03-30 05:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36dea350-3af6-5adb-90d7-60ffa6ece543 with identifier: UE56505
2026-03-30 05:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36dea350-3af6-5adb-90d7-60ffa6ece543 with identifier: UE56505 to the API
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'petrol',
 'id': '36dea350-3af6-5adb-90d7-60ffa6ece543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE56505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 174564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Cricket',
 'transmission': 'manual',
 'trim': 'Cricket',
 'year': 2004}
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE56505%27 HTTP/1.1" 200 None
2026-03-30 05:31:30 [auto1.de] INFO: Saving data for UE56505: {'auction_closing_time': 1774884421.0, 'created_time': 1774762242.580126, 'last_price_update_time': 1774848690.379683}
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE56505') HTTP/1.1" 204 0
2026-03-30 05:31:30 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-30 05:31:30 [auto1.de] INFO: Scrape type for ND89828: 2
2026-03-30 05:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daef6add-3283-5a0c-bfa3-a4f5754a2d6e with identifier: ND89828
2026-03-30 05:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daef6add-3283-5a0c-bfa3-a4f5754a2d6e with scrape type 2
2026-03-30 05:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daef6add-3283-5a0c-bfa3-a4f5754a2d6e with scrape type 2
2026-03-30 05:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daef6add-3283-5a0c-bfa3-a4f5754a2d6e, identifier: ND89828
2026-03-30 05:31:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:30 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-30 05:31:30 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-30 05:31:30 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-30 05:31:30 [auto1.de] INFO: Scrape type for TR93945: 2
2026-03-30 05:31:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574a6756-f3a8-558d-8f33-258da47c6100 with identifier: TR93945
2026-03-30 05:31:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574a6756-f3a8-558d-8f33-258da47c6100 with scrape type 2
2026-03-30 05:31:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574a6756-f3a8-558d-8f33-258da47c6100 with scrape type 2
2026-03-30 05:31:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574a6756-f3a8-558d-8f33-258da47c6100, identifier: TR93945
2026-03-30 05:31:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daef6add-3283-5a0c-bfa3-a4f5754a2d6e with identifier: ND89828
2026-03-30 05:31:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daef6add-3283-5a0c-bfa3-a4f5754a2d6e with identifier: ND89828
2026-03-30 05:31:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daef6add-3283-5a0c-bfa3-a4f5754a2d6e with identifier: ND89828 to the API
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:44:00Z',
 'fuel_type': 'petrol',
 'id': 'daef6add-3283-5a0c-bfa3-a4f5754a2d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND89828',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 159039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND89828%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Saving data for ND89828: {'auction_closing_time': 1774885440.0, 'created_time': 1774033053.909189, 'last_price_update_time': 1774848691.28549}
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND89828') HTTP/1.1" 204 0
2026-03-30 05:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574a6756-f3a8-558d-8f33-258da47c6100 with identifier: TR93945
2026-03-30 05:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574a6756-f3a8-558d-8f33-258da47c6100 with identifier: TR93945
2026-03-30 05:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574a6756-f3a8-558d-8f33-258da47c6100 with identifier: TR93945 to the API
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:25:29Z',
 'fuel_type': 'petrol',
 'id': '574a6756-f3a8-558d-8f33-258da47c6100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR93945',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 145672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR93945%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Saving data for TR93945: {'auction_closing_time': 1774884329.0, 'created_time': 1774762240.280974, 'last_price_update_time': 1774848691.772317}
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR93945') HTTP/1.1" 204 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for MF60875: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for RF07068: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-30 05:31:31 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-30 05:31:31 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 05:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for KD86114: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for EF75873: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for HZ55109: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for LA18154: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for CW95568: 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for UF10359: 2
2026-03-30 05:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with identifier: UF10359
2026-03-30 05:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with scrape type 2
2026-03-30 05:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with scrape type 2
2026-03-30 05:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38, identifier: UF10359
2026-03-30 05:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with identifier: UF10359
2026-03-30 05:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with identifier: UF10359
2026-03-30 05:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38 with identifier: UF10359 to the API
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:50:44Z',
 'fuel_type': 'diesel',
 'id': '9a2a76b7-dc36-5c1a-9460-7dcb1f63bd38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF10359',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 48476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi N-Connecta 4x4',
 'transmission': 'automatic',
 'trim': 'N-Connecta 4x4',
 'year': 2017}
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF10359%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Saving data for UF10359: {'auction_closing_time': 1774885844.0, 'created_time': 1774034337.045282, 'last_price_update_time': 1774848692.544136}
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF10359') HTTP/1.1" 204 0
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-30 05:31:32 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-30 05:31:32 [auto1.de] INFO: Scrape type for BN60503: 2
2026-03-30 05:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with identifier: BN60503
2026-03-30 05:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with scrape type 2
2026-03-30 05:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with scrape type 2
2026-03-30 05:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66, identifier: BN60503
2026-03-30 05:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with identifier: BN60503
2026-03-30 05:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with identifier: BN60503
2026-03-30 05:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66 with identifier: BN60503 to the API
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-30T15:22:49Z',
 'fuel_type': 'petrol',
 'id': '28d317ef-013a-5f3e-bbdd-5b9f3d2a9e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN60503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 85128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN60503%27 HTTP/1.1" 200 None
2026-03-30 05:31:33 [auto1.de] INFO: Saving data for BN60503: {'auction_closing_time': 1774884169.0, 'created_time': 1774089284.237548, 'last_price_update_time': 1774848693.121619}
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN60503') HTTP/1.1" 204 0
2026-03-30 05:31:33 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-30 05:31:33 [auto1.de] INFO: Scrape type for BG41279: 2
2026-03-30 05:31:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dda430f3-c70e-5ae7-99e9-a0e641ee099a with identifier: BG41279
2026-03-30 05:31:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dda430f3-c70e-5ae7-99e9-a0e641ee099a with scrape type 2
2026-03-30 05:31:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dda430f3-c70e-5ae7-99e9-a0e641ee099a with scrape type 2
2026-03-30 05:31:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dda430f3-c70e-5ae7-99e9-a0e641ee099a, identifier: BG41279
2026-03-30 05:31:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dda430f3-c70e-5ae7-99e9-a0e641ee099a with identifier: BG41279
2026-03-30 05:31:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dda430f3-c70e-5ae7-99e9-a0e641ee099a with identifier: BG41279
2026-03-30 05:31:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dda430f3-c70e-5ae7-99e9-a0e641ee099a with identifier: BG41279 to the API
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:54:33Z',
 'fuel_type': 'diesel',
 'id': 'dda430f3-c70e-5ae7-99e9-a0e641ee099a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG41279',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 199133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-01',
 'seller_name': None,
 'title': 'Toyota Avensis 2.0 D-4D Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG41279%27 HTTP/1.1" 200 None
2026-03-30 05:31:33 [auto1.de] INFO: Saving data for BG41279: {'auction_closing_time': 1774886073.0, 'created_time': 1774031607.648335, 'last_price_update_time': 1774848693.521517}
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG41279') HTTP/1.1" 204 0
2026-03-30 05:31:33 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-30 05:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:34 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for GD26044: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for NH06338: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for MF86039: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for SJ64604: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for DT57257: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for VT63649: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for JX79740: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for FR69109: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for BS19118: 0
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-30 05:31:34 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-30 05:31:34 [auto1.de] INFO: Scrape type for UP11609: 2
2026-03-30 05:31:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3503cc9f-225d-52a7-be8a-c2593e47705b with identifier: UP11609
2026-03-30 05:31:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3503cc9f-225d-52a7-be8a-c2593e47705b with scrape type 2
2026-03-30 05:31:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3503cc9f-225d-52a7-be8a-c2593e47705b with scrape type 2
2026-03-30 05:31:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3503cc9f-225d-52a7-be8a-c2593e47705b, identifier: UP11609
2026-03-30 05:31:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3503cc9f-225d-52a7-be8a-c2593e47705b with identifier: UP11609
2026-03-30 05:31:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3503cc9f-225d-52a7-be8a-c2593e47705b with identifier: UP11609
2026-03-30 05:31:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3503cc9f-225d-52a7-be8a-c2593e47705b with identifier: UP11609 to the API
2026-03-30 05:31:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:54:51Z',
 'fuel_type': 'diesel',
 'id': '3503cc9f-225d-52a7-be8a-c2593e47705b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP11609',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 167601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Saving data for UP11609: {'auction_closing_time': 1774886091.0, 'created_time': 1774639120.546166, 'last_price_update_time': 1774848695.113628}
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP11609') HTTP/1.1" 204 0
2026-03-30 05:31:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for SL92984: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for GH39731: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for SN42334: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for NV30450: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for ZW50012: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for AB49133: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for KB67170: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for KF93262: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for BP80209: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for FR18143: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for WF13702: 0
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-30 05:31:35 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-30 05:31:35 [auto1.de] INFO: Scrape type for HH06006: 0
2026-03-30 05:31:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:36 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for LU46217: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for DC32299: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for ZM10504: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for CH24864: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for NA60022: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for AK26500: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for JL32962: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for UN88738: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for TV18525: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for MU81714: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for ZL07582: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for PW12377: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for RD52099: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for CX30934: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-30 05:31:36 [auto1.de] INFO: Scrape type for KT37105: 0
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 05:31:36 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-30 05:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:37 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-30 05:31:37 [auto1.de] INFO: Scrape type for SS07399: 0
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-30 05:31:37 [auto1.de] INFO: Scrape type for RR54011: 0
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-30 05:31:37 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-30 05:31:37 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Scrape type for KP96972: 0
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Scrape type for AM69365: 2
2026-03-30 05:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe5a3ea0-7512-5463-b38f-33c82d7f960a with identifier: AM69365
2026-03-30 05:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe5a3ea0-7512-5463-b38f-33c82d7f960a with scrape type 2
2026-03-30 05:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe5a3ea0-7512-5463-b38f-33c82d7f960a with scrape type 2
2026-03-30 05:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe5a3ea0-7512-5463-b38f-33c82d7f960a, identifier: AM69365
2026-03-30 05:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe5a3ea0-7512-5463-b38f-33c82d7f960a with identifier: AM69365
2026-03-30 05:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe5a3ea0-7512-5463-b38f-33c82d7f960a with identifier: AM69365
2026-03-30 05:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe5a3ea0-7512-5463-b38f-33c82d7f960a with identifier: AM69365 to the API
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:01:48Z',
 'fuel_type': 'petrol',
 'id': 'fe5a3ea0-7512-5463-b38f-33c82d7f960a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM69365',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 71411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-28',
 'seller_name': None,
 'title': 'Audi Q2 30 TFSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2019}
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Saving data for AM69365: {'auction_closing_time': 1774882908.0, 'created_time': 1774637285.02572, 'last_price_update_time': 1774848698.583313}
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM69365') HTTP/1.1" 204 0
2026-03-30 05:31:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-30 05:31:38 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-30 05:31:38 [auto1.de] INFO: Scrape type for VV46079: 2
2026-03-30 05:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with identifier: VV46079
2026-03-30 05:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with scrape type 2
2026-03-30 05:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with scrape type 2
2026-03-30 05:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03, identifier: VV46079
2026-03-30 05:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with identifier: VV46079
2026-03-30 05:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with identifier: VV46079
2026-03-30 05:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9702a1f1-2c4a-584a-a5a8-00ee0cd47e03 with identifier: VV46079 to the API
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:03:25Z',
 'fuel_type': 'petrol',
 'id': '9702a1f1-2c4a-584a-a5a8-00ee0cd47e03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV46079',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 73629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-03',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2013}
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Saving data for VV46079: {'auction_closing_time': 1774883005.0, 'created_time': 1774636278.515448, 'last_price_update_time': 1774848699.084566}
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV46079') HTTP/1.1" 204 0
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Scrape type for XB74234: 2
2026-03-30 05:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383175b1-02b6-5700-8520-a18438d83da8 with identifier: XB74234
2026-03-30 05:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383175b1-02b6-5700-8520-a18438d83da8 with scrape type 2
2026-03-30 05:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383175b1-02b6-5700-8520-a18438d83da8 with scrape type 2
2026-03-30 05:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 383175b1-02b6-5700-8520-a18438d83da8, identifier: XB74234
2026-03-30 05:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 383175b1-02b6-5700-8520-a18438d83da8 with identifier: XB74234
2026-03-30 05:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 383175b1-02b6-5700-8520-a18438d83da8 with identifier: XB74234
2026-03-30 05:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 383175b1-02b6-5700-8520-a18438d83da8 with identifier: XB74234 to the API
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:17:12Z',
 'fuel_type': 'petrol',
 'id': '383175b1-02b6-5700-8520-a18438d83da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB74234',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 68913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Saving data for XB74234: {'auction_closing_time': 1774883832.0, 'created_time': 1774639213.614915, 'last_price_update_time': 1774848699.689099}
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB74234') HTTP/1.1" 204 0
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-30 05:31:39 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-30 05:31:39 [auto1.de] INFO: Scrape type for BD16858: 2
2026-03-30 05:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with identifier: BD16858
2026-03-30 05:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with scrape type 2
2026-03-30 05:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with scrape type 2
2026-03-30 05:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9, identifier: BD16858
2026-03-30 05:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with identifier: BD16858
2026-03-30 05:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with identifier: BD16858
2026-03-30 05:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9 with identifier: BD16858 to the API
2026-03-30 05:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:30Z',
 'fuel_type': 'petrol',
 'id': 'b6bdee7b-8268-5047-a2fe-cbe5cfc5c4c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD16858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 28067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-30 05:31:40 [auto1.de] INFO: Saving data for BD16858: {'auction_closing_time': 1774886130.0, 'created_time': 1773346493.150665, 'last_price_update_time': 1774848700.129184}
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD16858') HTTP/1.1" 204 0
2026-03-30 05:31:40 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-30 05:31:40 [auto1.de] INFO: Scrape type for VG72840: 2
2026-03-30 05:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with identifier: VG72840
2026-03-30 05:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with scrape type 2
2026-03-30 05:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with scrape type 2
2026-03-30 05:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4, identifier: VG72840
2026-03-30 05:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with identifier: VG72840
2026-03-30 05:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with identifier: VG72840
2026-03-30 05:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4 with identifier: VG72840 to the API
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:44Z',
 'fuel_type': 'diesel',
 'id': 'f62dee54-d1aa-5beb-bcc4-7b9b9b5598c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG72840',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 256319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2018}
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-30 05:31:40 [auto1.de] INFO: Saving data for VG72840: {'auction_closing_time': 1774886144.0, 'created_time': 1774639262.348872, 'last_price_update_time': 1774848700.629073}
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG72840') HTTP/1.1" 204 0
2026-03-30 05:31:40 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-30 05:31:40 [auto1.de] INFO: Scrape type for FR19321: 2
2026-03-30 05:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67ca74a2-db61-58f6-8121-b308e24b6fde with identifier: FR19321
2026-03-30 05:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67ca74a2-db61-58f6-8121-b308e24b6fde with scrape type 2
2026-03-30 05:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67ca74a2-db61-58f6-8121-b308e24b6fde with scrape type 2
2026-03-30 05:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67ca74a2-db61-58f6-8121-b308e24b6fde, identifier: FR19321
2026-03-30 05:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67ca74a2-db61-58f6-8121-b308e24b6fde with identifier: FR19321
2026-03-30 05:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67ca74a2-db61-58f6-8121-b308e24b6fde with identifier: FR19321
2026-03-30 05:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67ca74a2-db61-58f6-8121-b308e24b6fde with identifier: FR19321 to the API
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'diesel',
 'id': '67ca74a2-db61-58f6-8121-b308e24b6fde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR19321',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 255085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer xDrive Sport Line',
 'transmission': 'manual',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Saving data for FR19321: {'auction_closing_time': 1774885682.0, 'created_time': 1774549870.676121, 'last_price_update_time': 1774848701.036941}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR19321') HTTP/1.1" 204 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for GS08469: 2
2026-03-30 05:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf996f4-8084-577f-9f53-fe24d3a206ce with identifier: GS08469
2026-03-30 05:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf996f4-8084-577f-9f53-fe24d3a206ce with scrape type 2
2026-03-30 05:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf996f4-8084-577f-9f53-fe24d3a206ce with scrape type 2
2026-03-30 05:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eaf996f4-8084-577f-9f53-fe24d3a206ce, identifier: GS08469
2026-03-30 05:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eaf996f4-8084-577f-9f53-fe24d3a206ce with identifier: GS08469
2026-03-30 05:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eaf996f4-8084-577f-9f53-fe24d3a206ce with identifier: GS08469
2026-03-30 05:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eaf996f4-8084-577f-9f53-fe24d3a206ce with identifier: GS08469 to the API
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:23:10Z',
 'fuel_type': 'diesel',
 'id': 'eaf996f4-8084-577f-9f53-fe24d3a206ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS08469',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 90498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-27',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2019}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Saving data for GS08469: {'auction_closing_time': 1774884190.0, 'created_time': 1773303989.393238, 'last_price_update_time': 1774848701.459495}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS08469') HTTP/1.1" 204 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for KH12936: 2
2026-03-30 05:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f71240-c4ee-5341-999e-0f2b6d84bf08 with identifier: KH12936
2026-03-30 05:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f71240-c4ee-5341-999e-0f2b6d84bf08 with scrape type 2
2026-03-30 05:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f71240-c4ee-5341-999e-0f2b6d84bf08 with scrape type 2
2026-03-30 05:31:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12f71240-c4ee-5341-999e-0f2b6d84bf08, identifier: KH12936
2026-03-30 05:31:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12f71240-c4ee-5341-999e-0f2b6d84bf08 with identifier: KH12936
2026-03-30 05:31:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12f71240-c4ee-5341-999e-0f2b6d84bf08 with identifier: KH12936
2026-03-30 05:31:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12f71240-c4ee-5341-999e-0f2b6d84bf08 with identifier: KH12936 to the API
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:49:47Z',
 'fuel_type': 'diesel',
 'id': '12f71240-c4ee-5341-999e-0f2b6d84bf08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH12936',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 136479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-27',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line Allrad',
 'transmission': 'automatic',
 'trim': 'FR-Line Allrad',
 'year': 2018}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Saving data for KH12936: {'auction_closing_time': 1774885787.0, 'created_time': 1774638278.111281, 'last_price_update_time': 1774848701.88488}
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH12936') HTTP/1.1" 204 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-30 05:31:41 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-30 05:31:41 [auto1.de] INFO: Scrape type for KG33917: 2
2026-03-30 05:31:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with identifier: KG33917
2026-03-30 05:31:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with scrape type 2
2026-03-30 05:31:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with scrape type 2
2026-03-30 05:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93, identifier: KG33917
2026-03-30 05:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with identifier: KG33917
2026-03-30 05:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with identifier: KG33917
2026-03-30 05:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93 with identifier: KG33917 to the API
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:28Z',
 'fuel_type': 'petrol',
 'id': 'cedac1d8-f84c-5dbe-8c2d-dbef6ba1ba93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG33917',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 92450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2015}
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Saving data for KG33917: {'auction_closing_time': 1774884688.0, 'created_time': 1774636539.304908, 'last_price_update_time': 1774848702.300405}
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG33917') HTTP/1.1" 204 0
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-30 05:31:42 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Scrape type for AR18568: 2
2026-03-30 05:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with identifier: AR18568
2026-03-30 05:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with scrape type 2
2026-03-30 05:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with scrape type 2
2026-03-30 05:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6, identifier: AR18568
2026-03-30 05:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with identifier: AR18568
2026-03-30 05:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with identifier: AR18568
2026-03-30 05:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 724b2ea1-3fd3-55ce-b129-2a2d79cf92d6 with identifier: AR18568 to the API
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:14Z',
 'fuel_type': 'petrol',
 'id': '724b2ea1-3fd3-55ce-b129-2a2d79cf92d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR18568',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 181664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-04',
 'seller_name': None,
 'title': 'MINI Cabrio One',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Saving data for AR18568: {'auction_closing_time': 1774884674.0, 'created_time': 1774636510.446788, 'last_price_update_time': 1774848702.751356}
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR18568') HTTP/1.1" 204 0
2026-03-30 05:31:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Scrape type for ZK29983: 0
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-30 05:31:42 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-30 05:31:42 [auto1.de] INFO: Scrape type for YF63409: 2
2026-03-30 05:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b5510a-0460-52cb-87e9-da2181e427b0 with identifier: YF63409
2026-03-30 05:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b5510a-0460-52cb-87e9-da2181e427b0 with scrape type 2
2026-03-30 05:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b5510a-0460-52cb-87e9-da2181e427b0 with scrape type 2
2026-03-30 05:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79b5510a-0460-52cb-87e9-da2181e427b0, identifier: YF63409
2026-03-30 05:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79b5510a-0460-52cb-87e9-da2181e427b0 with identifier: YF63409
2026-03-30 05:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79b5510a-0460-52cb-87e9-da2181e427b0 with identifier: YF63409
2026-03-30 05:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79b5510a-0460-52cb-87e9-da2181e427b0 with identifier: YF63409 to the API
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'diesel',
 'id': '79b5510a-0460-52cb-87e9-da2181e427b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF63409',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 130391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-30 05:31:43 [auto1.de] INFO: Saving data for YF63409: {'auction_closing_time': 1774883133.0, 'created_time': 1774550026.82314, 'last_price_update_time': 1774848703.299378}
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF63409') HTTP/1.1" 204 0
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-30 05:31:43 [auto1.de] INFO: Scrape type for JJ82398: 2
2026-03-30 05:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 057ba4fe-3985-56ff-8843-5d2855701fdc with identifier: JJ82398
2026-03-30 05:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 057ba4fe-3985-56ff-8843-5d2855701fdc with scrape type 2
2026-03-30 05:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 057ba4fe-3985-56ff-8843-5d2855701fdc with scrape type 2
2026-03-30 05:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 057ba4fe-3985-56ff-8843-5d2855701fdc, identifier: JJ82398
2026-03-30 05:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 057ba4fe-3985-56ff-8843-5d2855701fdc with identifier: JJ82398
2026-03-30 05:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 057ba4fe-3985-56ff-8843-5d2855701fdc with identifier: JJ82398
2026-03-30 05:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 057ba4fe-3985-56ff-8843-5d2855701fdc with identifier: JJ82398 to the API
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:48Z',
 'fuel_type': 'diesel',
 'id': '057ba4fe-3985-56ff-8843-5d2855701fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ82398',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 290093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-30 05:31:43 [auto1.de] INFO: Saving data for JJ82398: {'auction_closing_time': 1774886148.0, 'created_time': 1774638635.798039, 'last_price_update_time': 1774848703.693392}
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ82398') HTTP/1.1" 204 0
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-30 05:31:43 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-30 05:31:43 [auto1.de] INFO: Scrape type for KT58980: 2
2026-03-30 05:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with identifier: KT58980
2026-03-30 05:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with scrape type 2
2026-03-30 05:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with scrape type 2
2026-03-30 05:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb021a2a-053f-51b2-8eb8-9112d1ccc3e3, identifier: KT58980
2026-03-30 05:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with identifier: KT58980
2026-03-30 05:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with identifier: KT58980
2026-03-30 05:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb021a2a-053f-51b2-8eb8-9112d1ccc3e3 with identifier: KT58980 to the API
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'petrol',
 'id': 'bb021a2a-053f-51b2-8eb8-9112d1ccc3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT58980',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 147084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-30 05:31:44 [auto1.de] INFO: Saving data for KT58980: {'auction_closing_time': 1774885761.0, 'created_time': 1774637343.460407, 'last_price_update_time': 1774848704.187033}
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT58980') HTTP/1.1" 204 0
2026-03-30 05:31:44 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-30 05:31:44 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-30 05:31:44 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-30 05:31:44 [auto1.de] INFO: Scrape type for JF69032: 2
2026-03-30 05:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with identifier: JF69032
2026-03-30 05:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with scrape type 2
2026-03-30 05:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with scrape type 2
2026-03-30 05:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3, identifier: JF69032
2026-03-30 05:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with identifier: JF69032
2026-03-30 05:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with identifier: JF69032
2026-03-30 05:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3 with identifier: JF69032 to the API
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-30T15:26:38Z',
 'fuel_type': 'petrol',
 'id': 'fae7ceaa-57c1-5d58-a6bd-238bfbe4c2b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF69032',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa Brera',
 'odometer': 43770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-09',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa Brera 3.2 JTS V6 Q4 Sky View',
 'transmission': 'manual',
 'trim': 'Q4 Sky View',
 'year': 2007}
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-30 05:31:44 [auto1.de] INFO: Saving data for JF69032: {'auction_closing_time': 1774884398.0, 'created_time': 1774639078.93353, 'last_price_update_time': 1774848704.617859}
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF69032') HTTP/1.1" 204 0
2026-03-30 05:31:44 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-30 05:31:44 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 05:31:44 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-30 05:31:44 [auto1.de] INFO: Scrape type for VV17039: 2
2026-03-30 05:31:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45259b05-a947-507e-8e37-a703a8268954 with identifier: VV17039
2026-03-30 05:31:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45259b05-a947-507e-8e37-a703a8268954 with scrape type 2
2026-03-30 05:31:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45259b05-a947-507e-8e37-a703a8268954 with scrape type 2
2026-03-30 05:31:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45259b05-a947-507e-8e37-a703a8268954, identifier: VV17039
2026-03-30 05:31:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45259b05-a947-507e-8e37-a703a8268954 with identifier: VV17039
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 05:31:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45259b05-a947-507e-8e37-a703a8268954 with identifier: VV17039
2026-03-30 05:31:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45259b05-a947-507e-8e37-a703a8268954 with identifier: VV17039 to the API
2026-03-30 05:31:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:34:42Z',
 'fuel_type': 'diesel',
 'id': '45259b05-a947-507e-8e37-a703a8268954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV17039',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 159824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2016}
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Saving data for VV17039: {'auction_closing_time': 1774884882.0, 'created_time': 1774637261.050222, 'last_price_update_time': 1774848705.17431}
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV17039') HTTP/1.1" 204 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for AS86297: 2
2026-03-30 05:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da06469b-46a7-5923-9d1f-a1b29e64161e with identifier: AS86297
2026-03-30 05:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da06469b-46a7-5923-9d1f-a1b29e64161e with scrape type 2
2026-03-30 05:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da06469b-46a7-5923-9d1f-a1b29e64161e with scrape type 2
2026-03-30 05:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da06469b-46a7-5923-9d1f-a1b29e64161e, identifier: AS86297
2026-03-30 05:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da06469b-46a7-5923-9d1f-a1b29e64161e with identifier: AS86297
2026-03-30 05:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da06469b-46a7-5923-9d1f-a1b29e64161e with identifier: AS86297
2026-03-30 05:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da06469b-46a7-5923-9d1f-a1b29e64161e with identifier: AS86297 to the API
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:43Z',
 'fuel_type': 'petrol',
 'id': 'da06469b-46a7-5923-9d1f-a1b29e64161e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS86297',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 7625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Saving data for AS86297: {'auction_closing_time': 1774885723.0, 'created_time': 1774550104.239739, 'last_price_update_time': 1774848705.809534}
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS86297') HTTP/1.1" 204 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-30 05:31:45 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-30 05:31:45 [auto1.de] INFO: Scrape type for WN56158: 0
2026-03-30 05:31:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:31:46 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6742 | hits on page: 40
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-30 05:31:46 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-30 05:31:46 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-30 05:31:46 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 05:31:46 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-30 05:31:46 [auto1.de] INFO: Scrape type for HM10464: 2
2026-03-30 05:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with identifier: HM10464
2026-03-30 05:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with scrape type 2
2026-03-30 05:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with scrape type 2
2026-03-30 05:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5af6f4f1-90cb-5a2c-95b2-721af6c90596, identifier: HM10464
2026-03-30 05:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with identifier: HM10464
2026-03-30 05:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with identifier: HM10464
2026-03-30 05:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5af6f4f1-90cb-5a2c-95b2-721af6c90596 with identifier: HM10464 to the API
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:54:47Z',
 'fuel_type': 'petrol',
 'id': '5af6f4f1-90cb-5a2c-95b2-721af6c90596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM10464',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 162291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 Flexifuel Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-30 05:31:47 [auto1.de] INFO: Saving data for HM10464: {'auction_closing_time': 1774886087.0, 'created_time': 1774032253.321278, 'last_price_update_time': 1774848707.204036}
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM10464') HTTP/1.1" 204 0
2026-03-30 05:31:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:31:47 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-30 05:31:47 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-30 05:31:47 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-30 05:31:47 [auto1.de] INFO: Scrape type for RB81391: 2
2026-03-30 05:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f207a0b-8ea2-5990-93f2-d0688404bff3 with identifier: RB81391
2026-03-30 05:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f207a0b-8ea2-5990-93f2-d0688404bff3 with scrape type 2
2026-03-30 05:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f207a0b-8ea2-5990-93f2-d0688404bff3 with scrape type 2
2026-03-30 05:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f207a0b-8ea2-5990-93f2-d0688404bff3, identifier: RB81391
2026-03-30 05:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f207a0b-8ea2-5990-93f2-d0688404bff3 with identifier: RB81391
2026-03-30 05:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f207a0b-8ea2-5990-93f2-d0688404bff3 with identifier: RB81391
2026-03-30 05:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f207a0b-8ea2-5990-93f2-d0688404bff3 with identifier: RB81391 to the API
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 281,
 'expiration_date': '2026-03-30T15:43:35Z',
 'fuel_type': 'petrol',
 'id': '8f207a0b-8ea2-5990-93f2-d0688404bff3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB81391',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 61131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-30 05:31:47 [auto1.de] INFO: Saving data for RB81391: {'auction_closing_time': 1774885415.0, 'created_time': 1774636562.638627, 'last_price_update_time': 1774848707.730831}
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB81391') HTTP/1.1" 204 0
2026-03-30 05:31:47 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-30 05:31:47 [auto1.de] INFO: Scrape type for DJ54071: 2
2026-03-30 05:31:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ca2660-e80f-5661-877e-90c5efa29949 with identifier: DJ54071
2026-03-30 05:31:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ca2660-e80f-5661-877e-90c5efa29949 with scrape type 2
2026-03-30 05:31:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7ca2660-e80f-5661-877e-90c5efa29949 with scrape type 2
2026-03-30 05:31:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7ca2660-e80f-5661-877e-90c5efa29949, identifier: DJ54071
2026-03-30 05:31:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7ca2660-e80f-5661-877e-90c5efa29949 with identifier: DJ54071
2026-03-30 05:31:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7ca2660-e80f-5661-877e-90c5efa29949 with identifier: DJ54071
2026-03-30 05:31:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7ca2660-e80f-5661-877e-90c5efa29949 with identifier: DJ54071 to the API
2026-03-30 05:31:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:56Z',
 'fuel_type': 'diesel',
 'id': 'd7ca2660-e80f-5661-877e-90c5efa29949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ54071',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 201288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2009}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-30 05:31:48 [auto1.de] INFO: Saving data for DJ54071: {'auction_closing_time': 1774884536.0, 'created_time': 1774549853.737467, 'last_price_update_time': 1774848708.149296}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ54071') HTTP/1.1" 204 0
2026-03-30 05:31:48 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-30 05:31:48 [auto1.de] INFO: Scrape type for DB44844: 2
2026-03-30 05:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f3ae77-abdc-5850-bef3-8cad2a6def01 with identifier: DB44844
2026-03-30 05:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f3ae77-abdc-5850-bef3-8cad2a6def01 with scrape type 2
2026-03-30 05:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14f3ae77-abdc-5850-bef3-8cad2a6def01 with scrape type 2
2026-03-30 05:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14f3ae77-abdc-5850-bef3-8cad2a6def01, identifier: DB44844
2026-03-30 05:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14f3ae77-abdc-5850-bef3-8cad2a6def01 with identifier: DB44844
2026-03-30 05:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14f3ae77-abdc-5850-bef3-8cad2a6def01 with identifier: DB44844
2026-03-30 05:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14f3ae77-abdc-5850-bef3-8cad2a6def01 with identifier: DB44844 to the API
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'petrol',
 'id': '14f3ae77-abdc-5850-bef3-8cad2a6def01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB44844',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 203427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-26',
 'seller_name': None,
 'title': 'Honda Civic 1.8 i-VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-30 05:31:48 [auto1.de] INFO: Saving data for DB44844: {'auction_closing_time': 1774884877.0, 'created_time': 1773341177.026221, 'last_price_update_time': 1774848708.544711}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB44844') HTTP/1.1" 204 0
2026-03-30 05:31:48 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-30 05:31:48 [auto1.de] INFO: Scrape type for GC63268: 2
2026-03-30 05:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with identifier: GC63268
2026-03-30 05:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with scrape type 2
2026-03-30 05:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with scrape type 2
2026-03-30 05:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd, identifier: GC63268
2026-03-30 05:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with identifier: GC63268
2026-03-30 05:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with identifier: GC63268
2026-03-30 05:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f65537e-d2ab-5210-a3bb-4cf089b5b3cd with identifier: GC63268 to the API
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:45:01Z',
 'fuel_type': 'petrol',
 'id': '0f65537e-d2ab-5210-a3bb-4cf089b5b3cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC63268',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 87526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-30 05:31:48 [auto1.de] INFO: Saving data for GC63268: {'auction_closing_time': 1774885501.0, 'created_time': 1773686308.111858, 'last_price_update_time': 1774848708.973263}
2026-03-30 05:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC63268') HTTP/1.1" 204 0
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Scrape type for UY73943: 0
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Scrape type for JB75617: 2
2026-03-30 05:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05a72ca-a1a3-57c3-bc25-5be4c236d603 with identifier: JB75617
2026-03-30 05:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05a72ca-a1a3-57c3-bc25-5be4c236d603 with scrape type 2
2026-03-30 05:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e05a72ca-a1a3-57c3-bc25-5be4c236d603 with scrape type 2
2026-03-30 05:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e05a72ca-a1a3-57c3-bc25-5be4c236d603, identifier: JB75617
2026-03-30 05:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e05a72ca-a1a3-57c3-bc25-5be4c236d603 with identifier: JB75617
2026-03-30 05:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e05a72ca-a1a3-57c3-bc25-5be4c236d603 with identifier: JB75617
2026-03-30 05:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e05a72ca-a1a3-57c3-bc25-5be4c236d603 with identifier: JB75617 to the API
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'diesel',
 'id': 'e05a72ca-a1a3-57c3-bc25-5be4c236d603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB75617',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 200109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Saving data for JB75617: {'auction_closing_time': 1774884925.0, 'created_time': 1773773620.673425, 'last_price_update_time': 1774848709.480679}
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB75617') HTTP/1.1" 204 0
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-30 05:31:49 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Scrape type for VB40940: 2
2026-03-30 05:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b4df00-1672-5855-bc7a-6dbc9a664dce with identifier: VB40940
2026-03-30 05:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b4df00-1672-5855-bc7a-6dbc9a664dce with scrape type 2
2026-03-30 05:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b4df00-1672-5855-bc7a-6dbc9a664dce with scrape type 2
2026-03-30 05:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2b4df00-1672-5855-bc7a-6dbc9a664dce, identifier: VB40940
2026-03-30 05:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2b4df00-1672-5855-bc7a-6dbc9a664dce with identifier: VB40940
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 05:31:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2b4df00-1672-5855-bc7a-6dbc9a664dce with identifier: VB40940
2026-03-30 05:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2b4df00-1672-5855-bc7a-6dbc9a664dce with identifier: VB40940 to the API
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:28:21Z',
 'fuel_type': 'petrol',
 'id': 'e2b4df00-1672-5855-bc7a-6dbc9a664dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB40940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 141523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 230 Kompressor T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2004}
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-30 05:31:49 [auto1.de] INFO: Saving data for VB40940: {'auction_closing_time': 1774884501.0, 'created_time': 1774549871.910802, 'last_price_update_time': 1774848709.9994}
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB40940') HTTP/1.1" 204 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for PC09054: 2
2026-03-30 05:31:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922aa6b7-d99b-5870-adc6-e627ef775da6 with identifier: PC09054
2026-03-30 05:31:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922aa6b7-d99b-5870-adc6-e627ef775da6 with scrape type 2
2026-03-30 05:31:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 922aa6b7-d99b-5870-adc6-e627ef775da6 with scrape type 2
2026-03-30 05:31:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 922aa6b7-d99b-5870-adc6-e627ef775da6, identifier: PC09054
2026-03-30 05:31:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 922aa6b7-d99b-5870-adc6-e627ef775da6 with identifier: PC09054
2026-03-30 05:31:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 922aa6b7-d99b-5870-adc6-e627ef775da6 with identifier: PC09054
2026-03-30 05:31:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 922aa6b7-d99b-5870-adc6-e627ef775da6 with identifier: PC09054 to the API
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:44:00Z',
 'fuel_type': 'petrol',
 'id': '922aa6b7-d99b-5870-adc6-e627ef775da6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC09054',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 71121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'Opel Adam 1.2 Open Air',
 'transmission': 'manual',
 'trim': 'Open Air',
 'year': 2015}
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Saving data for PC09054: {'auction_closing_time': 1774885440.0, 'created_time': 1774638431.925677, 'last_price_update_time': 1774848710.596689}
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC09054') HTTP/1.1" 204 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-30 05:31:50 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 05:31:50 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 05:32:06 [scrapy.extensions.logstats] INFO: Crawled 29 pages (at 16 pages/min), scraped 52 items (at 49 items/min)
2026-03-30 05:32:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:19 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:19 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 05:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Scrape type for AG77275: 2
2026-03-30 05:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd032625-8435-5c11-bf78-ffb91804271e with identifier: AG77275
2026-03-30 05:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd032625-8435-5c11-bf78-ffb91804271e with scrape type 2
2026-03-30 05:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd032625-8435-5c11-bf78-ffb91804271e with scrape type 2
2026-03-30 05:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd032625-8435-5c11-bf78-ffb91804271e, identifier: AG77275
2026-03-30 05:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd032625-8435-5c11-bf78-ffb91804271e with identifier: AG77275
2026-03-30 05:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd032625-8435-5c11-bf78-ffb91804271e with identifier: AG77275
2026-03-30 05:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd032625-8435-5c11-bf78-ffb91804271e with identifier: AG77275 to the API
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:12Z',
 'fuel_type': 'petrol',
 'id': 'cd032625-8435-5c11-bf78-ffb91804271e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG77275',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 30021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2014}
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Saving data for AG77275: {'auction_closing_time': 1774883292.0, 'created_time': 1774636679.830829, 'last_price_update_time': 1774848740.409246}
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG77275') HTTP/1.1" 204 0
2026-03-30 05:32:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Scrape type for BY58400: 0
2026-03-30 05:32:20 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Scrape type for LM03290: 2
2026-03-30 05:32:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9aa74d2-8aa1-5506-99b2-49fe42269f48 with identifier: LM03290
2026-03-30 05:32:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9aa74d2-8aa1-5506-99b2-49fe42269f48 with scrape type 2
2026-03-30 05:32:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9aa74d2-8aa1-5506-99b2-49fe42269f48 with scrape type 2
2026-03-30 05:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9aa74d2-8aa1-5506-99b2-49fe42269f48, identifier: LM03290
2026-03-30 05:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9aa74d2-8aa1-5506-99b2-49fe42269f48 with identifier: LM03290
2026-03-30 05:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9aa74d2-8aa1-5506-99b2-49fe42269f48 with identifier: LM03290
2026-03-30 05:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9aa74d2-8aa1-5506-99b2-49fe42269f48 with identifier: LM03290 to the API
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:14:17Z',
 'fuel_type': 'petrol',
 'id': 'd9aa74d2-8aa1-5506-99b2-49fe42269f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM03290',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 173268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-29',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-30 05:32:20 [auto1.de] INFO: Saving data for LM03290: {'auction_closing_time': 1774883657.0, 'created_time': 1774638230.58575, 'last_price_update_time': 1774848740.98306}
2026-03-30 05:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM03290') HTTP/1.1" 204 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for BP32495: 2
2026-03-30 05:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with identifier: BP32495
2026-03-30 05:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with scrape type 2
2026-03-30 05:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with scrape type 2
2026-03-30 05:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5f95e5-8005-5c8e-9231-919a0dd9dc07, identifier: BP32495
2026-03-30 05:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with identifier: BP32495
2026-03-30 05:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with identifier: BP32495
2026-03-30 05:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5f95e5-8005-5c8e-9231-919a0dd9dc07 with identifier: BP32495 to the API
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:12:57Z',
 'fuel_type': 'diesel',
 'id': 'ae5f95e5-8005-5c8e-9231-919a0dd9dc07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP32495',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 203480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-18',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Saving data for BP32495: {'auction_closing_time': 1774883577.0, 'created_time': 1773946170.455658, 'last_price_update_time': 1774848741.504527}
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP32495') HTTP/1.1" 204 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for ZM52655: 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for DG23161: 0
2026-03-30 05:32:21 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-30 05:32:21 [auto1.de] INFO: Scrape type for HT55268: 2
2026-03-30 05:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with identifier: HT55268
2026-03-30 05:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with scrape type 2
2026-03-30 05:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with scrape type 2
2026-03-30 05:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fc17df0-f9da-5a1e-8489-8e1b511f5463, identifier: HT55268
2026-03-30 05:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with identifier: HT55268
2026-03-30 05:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with identifier: HT55268
2026-03-30 05:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fc17df0-f9da-5a1e-8489-8e1b511f5463 with identifier: HT55268 to the API
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'petrol',
 'id': '3fc17df0-f9da-5a1e-8489-8e1b511f5463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT55268',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 180226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Saving data for HT55268: {'auction_closing_time': 1774882978.0, 'created_time': 1774521793.701358, 'last_price_update_time': 1774848742.057528}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT55268') HTTP/1.1" 204 0
2026-03-30 05:32:22 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-30 05:32:22 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Scrape type for GP28928: 2
2026-03-30 05:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed94d554-736e-5ac5-bba4-cc571139a42a with identifier: GP28928
2026-03-30 05:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed94d554-736e-5ac5-bba4-cc571139a42a with scrape type 2
2026-03-30 05:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed94d554-736e-5ac5-bba4-cc571139a42a with scrape type 2
2026-03-30 05:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed94d554-736e-5ac5-bba4-cc571139a42a, identifier: GP28928
2026-03-30 05:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed94d554-736e-5ac5-bba4-cc571139a42a with identifier: GP28928
2026-03-30 05:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed94d554-736e-5ac5-bba4-cc571139a42a with identifier: GP28928
2026-03-30 05:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed94d554-736e-5ac5-bba4-cc571139a42a with identifier: GP28928 to the API
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:08:32Z',
 'fuel_type': 'petrol',
 'id': 'ed94d554-736e-5ac5-bba4-cc571139a42a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP28928',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 114864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition 2WD',
 'year': 2016}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Saving data for GP28928: {'auction_closing_time': 1774883312.0, 'created_time': 1774637183.166311, 'last_price_update_time': 1774848742.489221}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP28928') HTTP/1.1" 204 0
2026-03-30 05:32:22 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-30 05:32:22 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Scrape type for JH84206: 2
2026-03-30 05:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with identifier: JH84206
2026-03-30 05:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with scrape type 2
2026-03-30 05:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with scrape type 2
2026-03-30 05:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e, identifier: JH84206
2026-03-30 05:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with identifier: JH84206
2026-03-30 05:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with identifier: JH84206
2026-03-30 05:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e with identifier: JH84206 to the API
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:27:24Z',
 'fuel_type': 'diesel',
 'id': 'c5f5cf9c-6c9a-58cd-ac75-a0f7c515194e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH84206',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 94981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-30 05:32:22 [auto1.de] INFO: Saving data for JH84206: {'auction_closing_time': 1774884444.0, 'created_time': 1774549927.706555, 'last_price_update_time': 1774848742.936757}
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH84206') HTTP/1.1" 204 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for RB85475: 2
2026-03-30 05:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1312b5-35c4-590a-8932-fbb1f9c4492d with identifier: RB85475
2026-03-30 05:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1312b5-35c4-590a-8932-fbb1f9c4492d with scrape type 2
2026-03-30 05:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1312b5-35c4-590a-8932-fbb1f9c4492d with scrape type 2
2026-03-30 05:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a1312b5-35c4-590a-8932-fbb1f9c4492d, identifier: RB85475
2026-03-30 05:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a1312b5-35c4-590a-8932-fbb1f9c4492d with identifier: RB85475
2026-03-30 05:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a1312b5-35c4-590a-8932-fbb1f9c4492d with identifier: RB85475
2026-03-30 05:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a1312b5-35c4-590a-8932-fbb1f9c4492d with identifier: RB85475 to the API
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 254,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'diesel',
 'id': '8a1312b5-35c4-590a-8932-fbb1f9c4492d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB85475',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 10335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-23',
 'seller_name': None,
 'title': 'Mazda CX-60 3.3 e-Skyactiv D Homura AWD',
 'transmission': 'automatic',
 'trim': 'Homura AWD',
 'year': 2024}
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Saving data for RB85475: {'auction_closing_time': 1774883189.0, 'created_time': 1774637916.463336, 'last_price_update_time': 1774848743.45006}
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB85475') HTTP/1.1" 204 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for AF35013: 2
2026-03-30 05:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc63c33-1148-5973-8c1c-bcec03be4f79 with identifier: AF35013
2026-03-30 05:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc63c33-1148-5973-8c1c-bcec03be4f79 with scrape type 2
2026-03-30 05:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbc63c33-1148-5973-8c1c-bcec03be4f79 with scrape type 2
2026-03-30 05:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbc63c33-1148-5973-8c1c-bcec03be4f79, identifier: AF35013
2026-03-30 05:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbc63c33-1148-5973-8c1c-bcec03be4f79 with identifier: AF35013
2026-03-30 05:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbc63c33-1148-5973-8c1c-bcec03be4f79 with identifier: AF35013
2026-03-30 05:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbc63c33-1148-5973-8c1c-bcec03be4f79 with identifier: AF35013 to the API
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'hybrid',
 'id': 'bbc63c33-1148-5973-8c1c-bcec03be4f79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF35013',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 151334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Top 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Top 4WD',
 'year': 2015}
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Saving data for AF35013: {'auction_closing_time': 1774886205.0, 'created_time': 1773830553.060541, 'last_price_update_time': 1774848743.849716}
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF35013') HTTP/1.1" 204 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for JV22464: 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for GY48177: 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-30 05:32:23 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-30 05:32:23 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-30 05:32:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:24 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:24 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-30 05:32:24 [auto1.de] INFO: Scrape type for JT14864: 2
2026-03-30 05:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628bb467-2a8b-5494-a9ef-6ef053f04c11 with identifier: JT14864
2026-03-30 05:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628bb467-2a8b-5494-a9ef-6ef053f04c11 with scrape type 2
2026-03-30 05:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 628bb467-2a8b-5494-a9ef-6ef053f04c11 with scrape type 2
2026-03-30 05:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 628bb467-2a8b-5494-a9ef-6ef053f04c11, identifier: JT14864
2026-03-30 05:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 628bb467-2a8b-5494-a9ef-6ef053f04c11 with identifier: JT14864
2026-03-30 05:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 628bb467-2a8b-5494-a9ef-6ef053f04c11 with identifier: JT14864
2026-03-30 05:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 628bb467-2a8b-5494-a9ef-6ef053f04c11 with identifier: JT14864 to the API
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:23:51Z',
 'fuel_type': 'diesel',
 'id': '628bb467-2a8b-5494-a9ef-6ef053f04c11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT14864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 230885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-20',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-30 05:32:24 [auto1.de] INFO: Saving data for JT14864: {'auction_closing_time': 1774884231.0, 'created_time': 1774550150.655105, 'last_price_update_time': 1774848744.982154}
2026-03-30 05:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT14864') HTTP/1.1" 204 0
2026-03-30 05:32:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for VS79881: 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for PH65688: 2
2026-03-30 05:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284bad12-bee5-541f-84d0-b29795660133 with identifier: PH65688
2026-03-30 05:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284bad12-bee5-541f-84d0-b29795660133 with scrape type 2
2026-03-30 05:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284bad12-bee5-541f-84d0-b29795660133 with scrape type 2
2026-03-30 05:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 284bad12-bee5-541f-84d0-b29795660133, identifier: PH65688
2026-03-30 05:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 284bad12-bee5-541f-84d0-b29795660133 with identifier: PH65688
2026-03-30 05:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 284bad12-bee5-541f-84d0-b29795660133 with identifier: PH65688
2026-03-30 05:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 284bad12-bee5-541f-84d0-b29795660133 with identifier: PH65688 to the API
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:17:32Z',
 'fuel_type': 'petrol',
 'id': '284bad12-bee5-541f-84d0-b29795660133',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH65688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 8631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-19',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2024}
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Saving data for PH65688: {'auction_closing_time': 1774883852.0, 'created_time': 1774636453.352594, 'last_price_update_time': 1774848745.577202}
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH65688') HTTP/1.1" 204 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-30 05:32:25 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-30 05:32:25 [auto1.de] INFO: Scrape type for XR81453: 2
2026-03-30 05:32:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2e4ff04-91e6-5b5f-bade-8096fd70f10c with identifier: XR81453
2026-03-30 05:32:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2e4ff04-91e6-5b5f-bade-8096fd70f10c with scrape type 2
2026-03-30 05:32:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2e4ff04-91e6-5b5f-bade-8096fd70f10c with scrape type 2
2026-03-30 05:32:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2e4ff04-91e6-5b5f-bade-8096fd70f10c, identifier: XR81453
2026-03-30 05:32:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2e4ff04-91e6-5b5f-bade-8096fd70f10c with identifier: XR81453
2026-03-30 05:32:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2e4ff04-91e6-5b5f-bade-8096fd70f10c with identifier: XR81453
2026-03-30 05:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2e4ff04-91e6-5b5f-bade-8096fd70f10c with identifier: XR81453 to the API
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:08:15Z',
 'fuel_type': 'petrol',
 'id': 'c2e4ff04-91e6-5b5f-bade-8096fd70f10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR81453',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 137944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CGI 4Matic BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Saving data for XR81453: {'auction_closing_time': 1774883295.0, 'created_time': 1774349317.829759, 'last_price_update_time': 1774848746.068005}
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR81453') HTTP/1.1" 204 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for RY72669: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for MY28321: 2
2026-03-30 05:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with identifier: MY28321
2026-03-30 05:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with scrape type 2
2026-03-30 05:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with scrape type 2
2026-03-30 05:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3, identifier: MY28321
2026-03-30 05:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with identifier: MY28321
2026-03-30 05:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with identifier: MY28321
2026-03-30 05:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3 with identifier: MY28321 to the API
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:44:33Z',
 'fuel_type': 'petrol',
 'id': '5a67c30a-b551-5d62-bca1-1e0c5a1fb7d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY28321',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 35059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Saving data for MY28321: {'auction_closing_time': 1774885473.0, 'created_time': 1774637249.915703, 'last_price_update_time': 1774848746.624492}
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY28321') HTTP/1.1" 204 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for SB37681: 0
2026-03-30 05:32:26 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-30 05:32:26 [auto1.de] INFO: Scrape type for CS81826: 2
2026-03-30 05:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131b9972-088e-53c6-bb9e-56332d105524 with identifier: CS81826
2026-03-30 05:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131b9972-088e-53c6-bb9e-56332d105524 with scrape type 2
2026-03-30 05:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 131b9972-088e-53c6-bb9e-56332d105524 with scrape type 2
2026-03-30 05:32:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 131b9972-088e-53c6-bb9e-56332d105524, identifier: CS81826
2026-03-30 05:32:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 131b9972-088e-53c6-bb9e-56332d105524 with identifier: CS81826
2026-03-30 05:32:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 131b9972-088e-53c6-bb9e-56332d105524 with identifier: CS81826
2026-03-30 05:32:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 131b9972-088e-53c6-bb9e-56332d105524 with identifier: CS81826 to the API
2026-03-30 05:32:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'petrol',
 'id': '131b9972-088e-53c6-bb9e-56332d105524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS81826',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 70374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-30',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300 4Drive',
 'transmission': 'automatic',
 'trim': 'Cupra 300 4Drive',
 'year': 2019}
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-30 05:32:27 [auto1.de] INFO: Saving data for CS81826: {'auction_closing_time': 1774885382.0, 'created_time': 1774349760.767299, 'last_price_update_time': 1774848747.140244}
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS81826') HTTP/1.1" 204 0
2026-03-30 05:32:27 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-30 05:32:27 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-30 05:32:27 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-30 05:32:27 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-30 05:32:27 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-30 05:32:27 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-30 05:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:28 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-30 05:32:28 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-30 05:32:28 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-30 05:32:28 [auto1.de] INFO: Scrape type for SP41663: 2
2026-03-30 05:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17518788-c1e5-5142-8765-cbddad632385 with identifier: SP41663
2026-03-30 05:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17518788-c1e5-5142-8765-cbddad632385 with scrape type 2
2026-03-30 05:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17518788-c1e5-5142-8765-cbddad632385 with scrape type 2
2026-03-30 05:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17518788-c1e5-5142-8765-cbddad632385, identifier: SP41663
2026-03-30 05:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17518788-c1e5-5142-8765-cbddad632385 with identifier: SP41663
2026-03-30 05:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17518788-c1e5-5142-8765-cbddad632385 with identifier: SP41663
2026-03-30 05:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17518788-c1e5-5142-8765-cbddad632385 with identifier: SP41663 to the API
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:56:52Z',
 'fuel_type': 'petrol',
 'id': '17518788-c1e5-5142-8765-cbddad632385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41663',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 200941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-31',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-30 05:32:28 [auto1.de] INFO: Saving data for SP41663: {'auction_closing_time': 1774886212.0, 'created_time': 1773132181.687527, 'last_price_update_time': 1774848748.807412}
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP41663') HTTP/1.1" 204 0
2026-03-30 05:32:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-30 05:32:28 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-30 05:32:28 [auto1.de] INFO: Scrape type for LS72141: 2
2026-03-30 05:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-03-30 05:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with scrape type 2
2026-03-30 05:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with scrape type 2
2026-03-30 05:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca, identifier: LS72141
2026-03-30 05:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-03-30 05:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141
2026-03-30 05:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3a1bcc7-b2de-51c1-aeb3-55e14af64fca with identifier: LS72141 to the API
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'petrol',
 'id': 'd3a1bcc7-b2de-51c1-aeb3-55e14af64fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS72141',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 103523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2009}
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Saving data for LS72141: {'auction_closing_time': 1774886199.0, 'created_time': 1773306266.019416, 'last_price_update_time': 1774848749.216277}
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS72141') HTTP/1.1" 204 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for CV29491: 2
2026-03-30 05:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2069e62-521d-5756-9615-b28b5f03b84f with identifier: CV29491
2026-03-30 05:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2069e62-521d-5756-9615-b28b5f03b84f with scrape type 2
2026-03-30 05:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2069e62-521d-5756-9615-b28b5f03b84f with scrape type 2
2026-03-30 05:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2069e62-521d-5756-9615-b28b5f03b84f, identifier: CV29491
2026-03-30 05:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2069e62-521d-5756-9615-b28b5f03b84f with identifier: CV29491
2026-03-30 05:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2069e62-521d-5756-9615-b28b5f03b84f with identifier: CV29491
2026-03-30 05:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2069e62-521d-5756-9615-b28b5f03b84f with identifier: CV29491 to the API
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:24:52Z',
 'fuel_type': 'diesel',
 'id': 'f2069e62-521d-5756-9615-b28b5f03b84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV29491',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 198830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2017}
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Saving data for CV29491: {'auction_closing_time': 1774884292.0, 'created_time': 1773945717.104274, 'last_price_update_time': 1774848749.846699}
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV29491') HTTP/1.1" 204 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-30 05:32:29 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-30 05:32:29 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-30 05:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for GJ72633: 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for BB70854: 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for HA43942: 2
2026-03-30 05:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc55768-8ccc-54b7-9a12-4de99bc8c55a with identifier: HA43942
2026-03-30 05:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc55768-8ccc-54b7-9a12-4de99bc8c55a with scrape type 2
2026-03-30 05:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc55768-8ccc-54b7-9a12-4de99bc8c55a with scrape type 2
2026-03-30 05:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc55768-8ccc-54b7-9a12-4de99bc8c55a, identifier: HA43942
2026-03-30 05:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc55768-8ccc-54b7-9a12-4de99bc8c55a with identifier: HA43942
2026-03-30 05:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc55768-8ccc-54b7-9a12-4de99bc8c55a with identifier: HA43942
2026-03-30 05:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc55768-8ccc-54b7-9a12-4de99bc8c55a with identifier: HA43942 to the API
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:32:20Z',
 'fuel_type': 'diesel',
 'id': 'edc55768-8ccc-54b7-9a12-4de99bc8c55a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA43942',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 138917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'BMW 3er 320d Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2016}
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Saving data for HA43942: {'auction_closing_time': 1774884740.0, 'created_time': 1773426881.999702, 'last_price_update_time': 1774848750.457037}
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA43942') HTTP/1.1" 204 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Scrape type for VP85116: 2
2026-03-30 05:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with identifier: VP85116
2026-03-30 05:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with scrape type 2
2026-03-30 05:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with scrape type 2
2026-03-30 05:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340e6e1f-149a-5ffa-b98a-c0c3cbf90198, identifier: VP85116
2026-03-30 05:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with identifier: VP85116
2026-03-30 05:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with identifier: VP85116
2026-03-30 05:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340e6e1f-149a-5ffa-b98a-c0c3cbf90198 with identifier: VP85116 to the API
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:09Z',
 'fuel_type': 'petrol',
 'id': '340e6e1f-149a-5ffa-b98a-c0c3cbf90198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP85116',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 52383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-30 05:32:30 [auto1.de] INFO: Saving data for VP85116: {'auction_closing_time': 1774882809.0, 'created_time': 1774637981.938893, 'last_price_update_time': 1774848750.966478}
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP85116') HTTP/1.1" 204 0
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-30 05:32:30 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-30 05:32:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:32 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-30 05:32:32 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-30 05:32:32 [auto1.de] INFO: Scrape type for ZM17001: 0
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-30 05:32:32 [auto1.de] INFO: Scrape type for DU31630: 2
2026-03-30 05:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba6b82e-c686-54fc-bbe3-f29632575122 with identifier: DU31630
2026-03-30 05:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba6b82e-c686-54fc-bbe3-f29632575122 with scrape type 2
2026-03-30 05:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba6b82e-c686-54fc-bbe3-f29632575122 with scrape type 2
2026-03-30 05:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ba6b82e-c686-54fc-bbe3-f29632575122, identifier: DU31630
2026-03-30 05:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ba6b82e-c686-54fc-bbe3-f29632575122 with identifier: DU31630
2026-03-30 05:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ba6b82e-c686-54fc-bbe3-f29632575122 with identifier: DU31630
2026-03-30 05:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ba6b82e-c686-54fc-bbe3-f29632575122 with identifier: DU31630 to the API
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:54:06Z',
 'fuel_type': 'petrol',
 'id': '0ba6b82e-c686-54fc-bbe3-f29632575122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU31630',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 80940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-30 05:32:32 [auto1.de] INFO: Saving data for DU31630: {'auction_closing_time': 1774886046.0, 'created_time': 1774638339.087324, 'last_price_update_time': 1774848752.760019}
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU31630') HTTP/1.1" 204 0
2026-03-30 05:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:32 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-30 05:32:32 [auto1.de] INFO: Scrape type for WX50182: 2
2026-03-30 05:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with identifier: WX50182
2026-03-30 05:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with scrape type 2
2026-03-30 05:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with scrape type 2
2026-03-30 05:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 778ad94d-e2c3-584d-9af2-860ec5b5cea8, identifier: WX50182
2026-03-30 05:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with identifier: WX50182
2026-03-30 05:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with identifier: WX50182
2026-03-30 05:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 778ad94d-e2c3-584d-9af2-860ec5b5cea8 with identifier: WX50182 to the API
2026-03-30 05:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'petrol',
 'id': '778ad94d-e2c3-584d-9af2-860ec5b5cea8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX50182',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 54285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Saving data for WX50182: {'auction_closing_time': 1774883599.0, 'created_time': 1774639296.332905, 'last_price_update_time': 1774848753.192435}
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX50182') HTTP/1.1" 204 0
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Scrape type for SE25361: 2
2026-03-30 05:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c78ed7-e8a4-5202-9945-755ba03017d0 with identifier: SE25361
2026-03-30 05:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c78ed7-e8a4-5202-9945-755ba03017d0 with scrape type 2
2026-03-30 05:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c78ed7-e8a4-5202-9945-755ba03017d0 with scrape type 2
2026-03-30 05:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34c78ed7-e8a4-5202-9945-755ba03017d0, identifier: SE25361
2026-03-30 05:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34c78ed7-e8a4-5202-9945-755ba03017d0 with identifier: SE25361
2026-03-30 05:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34c78ed7-e8a4-5202-9945-755ba03017d0 with identifier: SE25361
2026-03-30 05:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34c78ed7-e8a4-5202-9945-755ba03017d0 with identifier: SE25361 to the API
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:56Z',
 'fuel_type': 'petrol',
 'id': '34c78ed7-e8a4-5202-9945-755ba03017d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE25361',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 178315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-21',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Type S',
 'transmission': 'manual',
 'trim': 'Type S',
 'year': 2008}
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Saving data for SE25361: {'auction_closing_time': 1774883096.0, 'created_time': 1774639146.392889, 'last_price_update_time': 1774848753.64514}
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE25361') HTTP/1.1" 204 0
2026-03-30 05:32:33 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-30 05:32:33 [auto1.de] INFO: Scrape type for CD93100: 2
2026-03-30 05:32:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe36d0bb-24e3-5967-b143-06c93e838e2f with identifier: CD93100
2026-03-30 05:32:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe36d0bb-24e3-5967-b143-06c93e838e2f with scrape type 2
2026-03-30 05:32:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe36d0bb-24e3-5967-b143-06c93e838e2f with scrape type 2
2026-03-30 05:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe36d0bb-24e3-5967-b143-06c93e838e2f, identifier: CD93100
2026-03-30 05:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe36d0bb-24e3-5967-b143-06c93e838e2f with identifier: CD93100
2026-03-30 05:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe36d0bb-24e3-5967-b143-06c93e838e2f with identifier: CD93100
2026-03-30 05:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe36d0bb-24e3-5967-b143-06c93e838e2f with identifier: CD93100 to the API
2026-03-30 05:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-30T15:49:06Z',
 'fuel_type': 'diesel',
 'id': 'fe36d0bb-24e3-5967-b143-06c93e838e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD93100',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 79586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-16',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Saving data for CD93100: {'auction_closing_time': 1774885746.0, 'created_time': 1774637979.560888, 'last_price_update_time': 1774848754.144696}
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD93100') HTTP/1.1" 204 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for WA68072: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for LV55209: 2
2026-03-30 05:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcd3bd7b-1f14-582b-b912-8d85d742d510 with identifier: LV55209
2026-03-30 05:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcd3bd7b-1f14-582b-b912-8d85d742d510 with scrape type 2
2026-03-30 05:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcd3bd7b-1f14-582b-b912-8d85d742d510 with scrape type 2
2026-03-30 05:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcd3bd7b-1f14-582b-b912-8d85d742d510, identifier: LV55209
2026-03-30 05:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcd3bd7b-1f14-582b-b912-8d85d742d510 with identifier: LV55209
2026-03-30 05:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcd3bd7b-1f14-582b-b912-8d85d742d510 with identifier: LV55209
2026-03-30 05:32:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcd3bd7b-1f14-582b-b912-8d85d742d510 with identifier: LV55209 to the API
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': 'fcd3bd7b-1f14-582b-b912-8d85d742d510',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV55209',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 200696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-24',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Tekna 4x4',
 'transmission': 'manual',
 'trim': 'Tekna 4x4',
 'year': 2012}
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Saving data for LV55209: {'auction_closing_time': 1774885033.0, 'created_time': 1773228291.623207, 'last_price_update_time': 1774848754.729696}
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV55209') HTTP/1.1" 204 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for LC33794: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for HP02844: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-30 05:32:34 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-30 05:32:34 [auto1.de] INFO: Scrape type for TA32254: 2
2026-03-30 05:32:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8809fac7-2c99-5016-8b3f-31674783f1c6 with identifier: TA32254
2026-03-30 05:32:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8809fac7-2c99-5016-8b3f-31674783f1c6 with scrape type 2
2026-03-30 05:32:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8809fac7-2c99-5016-8b3f-31674783f1c6 with scrape type 2
2026-03-30 05:32:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8809fac7-2c99-5016-8b3f-31674783f1c6, identifier: TA32254
2026-03-30 05:32:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8809fac7-2c99-5016-8b3f-31674783f1c6 with identifier: TA32254
2026-03-30 05:32:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8809fac7-2c99-5016-8b3f-31674783f1c6 with identifier: TA32254
2026-03-30 05:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8809fac7-2c99-5016-8b3f-31674783f1c6 with identifier: TA32254 to the API
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'petrol',
 'id': '8809fac7-2c99-5016-8b3f-31674783f1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA32254',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 96745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2019}
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Saving data for TA32254: {'auction_closing_time': 1774884382.0, 'created_time': 1774637154.547899, 'last_price_update_time': 1774848755.220775}
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA32254') HTTP/1.1" 204 0
2026-03-30 05:32:35 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-30 05:32:35 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Scrape type for FK33509: 2
2026-03-30 05:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e60f37d0-df3d-5db5-bade-051e49802ce8 with identifier: FK33509
2026-03-30 05:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60f37d0-df3d-5db5-bade-051e49802ce8 with scrape type 2
2026-03-30 05:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e60f37d0-df3d-5db5-bade-051e49802ce8 with scrape type 2
2026-03-30 05:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e60f37d0-df3d-5db5-bade-051e49802ce8, identifier: FK33509
2026-03-30 05:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e60f37d0-df3d-5db5-bade-051e49802ce8 with identifier: FK33509
2026-03-30 05:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e60f37d0-df3d-5db5-bade-051e49802ce8 with identifier: FK33509
2026-03-30 05:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e60f37d0-df3d-5db5-bade-051e49802ce8 with identifier: FK33509 to the API
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:40:18Z',
 'fuel_type': 'petrol',
 'id': 'e60f37d0-df3d-5db5-bade-051e49802ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK33509',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 45696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-11',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Saving data for FK33509: {'auction_closing_time': 1774885218.0, 'created_time': 1774637537.670063, 'last_price_update_time': 1774848755.720503}
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK33509') HTTP/1.1" 204 0
2026-03-30 05:32:35 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-30 05:32:35 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-30 05:32:35 [auto1.de] INFO: Scrape type for DH40869: 2
2026-03-30 05:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with identifier: DH40869
2026-03-30 05:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with scrape type 2
2026-03-30 05:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with scrape type 2
2026-03-30 05:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b95015d-8a02-517a-b2b5-6f218e4bcc98, identifier: DH40869
2026-03-30 05:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with identifier: DH40869
2026-03-30 05:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with identifier: DH40869
2026-03-30 05:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b95015d-8a02-517a-b2b5-6f218e4bcc98 with identifier: DH40869 to the API
2026-03-30 05:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:53:52Z',
 'fuel_type': 'diesel',
 'id': '3b95015d-8a02-517a-b2b5-6f218e4bcc98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH40869',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 171816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC Edition 1',
 'transmission': 'automatic',
 'trim': 'BlueTEC Edition 1',
 'year': 2012}
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Saving data for DH40869: {'auction_closing_time': 1774886032.0, 'created_time': 1774034366.189292, 'last_price_update_time': 1774848756.134284}
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH40869') HTTP/1.1" 204 0
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Scrape type for WX73478: 2
2026-03-30 05:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 207a3f87-2529-54f0-a708-a2862ad91a74 with identifier: WX73478
2026-03-30 05:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 207a3f87-2529-54f0-a708-a2862ad91a74 with scrape type 2
2026-03-30 05:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 207a3f87-2529-54f0-a708-a2862ad91a74 with scrape type 2
2026-03-30 05:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 207a3f87-2529-54f0-a708-a2862ad91a74, identifier: WX73478
2026-03-30 05:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 207a3f87-2529-54f0-a708-a2862ad91a74 with identifier: WX73478
2026-03-30 05:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 207a3f87-2529-54f0-a708-a2862ad91a74 with identifier: WX73478
2026-03-30 05:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 207a3f87-2529-54f0-a708-a2862ad91a74 with identifier: WX73478 to the API
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:09:52Z',
 'fuel_type': 'petrol',
 'id': '207a3f87-2529-54f0-a708-a2862ad91a74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX73478',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 199455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Saving data for WX73478: {'auction_closing_time': 1774883392.0, 'created_time': 1773946113.076164, 'last_price_update_time': 1774848756.564537}
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX73478') HTTP/1.1" 204 0
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-30 05:32:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:36 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-30 05:32:36 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-30 05:32:36 [auto1.de] INFO: Scrape type for CK29715: 2
2026-03-30 05:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5558b0-8990-5709-9cce-75d9b41c7862 with identifier: CK29715
2026-03-30 05:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5558b0-8990-5709-9cce-75d9b41c7862 with scrape type 2
2026-03-30 05:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e5558b0-8990-5709-9cce-75d9b41c7862 with scrape type 2
2026-03-30 05:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e5558b0-8990-5709-9cce-75d9b41c7862, identifier: CK29715
2026-03-30 05:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e5558b0-8990-5709-9cce-75d9b41c7862 with identifier: CK29715
2026-03-30 05:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e5558b0-8990-5709-9cce-75d9b41c7862 with identifier: CK29715
2026-03-30 05:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e5558b0-8990-5709-9cce-75d9b41c7862 with identifier: CK29715 to the API
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'petrol',
 'id': '6e5558b0-8990-5709-9cce-75d9b41c7862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK29715',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 142345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-23',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2009}
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Saving data for CK29715: {'auction_closing_time': 1774883645.0, 'created_time': 1774636307.472565, 'last_price_update_time': 1774848757.214029}
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK29715') HTTP/1.1" 204 0
2026-03-30 05:32:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Scrape type for WT17427: 2
2026-03-30 05:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae5e4a3-1216-5762-9a9f-37151fe30736 with identifier: WT17427
2026-03-30 05:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae5e4a3-1216-5762-9a9f-37151fe30736 with scrape type 2
2026-03-30 05:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae5e4a3-1216-5762-9a9f-37151fe30736 with scrape type 2
2026-03-30 05:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae5e4a3-1216-5762-9a9f-37151fe30736, identifier: WT17427
2026-03-30 05:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae5e4a3-1216-5762-9a9f-37151fe30736 with identifier: WT17427
2026-03-30 05:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae5e4a3-1216-5762-9a9f-37151fe30736 with identifier: WT17427
2026-03-30 05:32:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae5e4a3-1216-5762-9a9f-37151fe30736 with identifier: WT17427 to the API
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:49Z',
 'fuel_type': 'diesel',
 'id': '1ae5e4a3-1216-5762-9a9f-37151fe30736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT17427',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 79569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Saving data for WT17427: {'auction_closing_time': 1774884649.0, 'created_time': 1774549928.308888, 'last_price_update_time': 1774848757.736222}
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT17427') HTTP/1.1" 204 0
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-30 05:32:37 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-30 05:32:37 [auto1.de] INFO: Scrape type for DX86501: 2
2026-03-30 05:32:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f3004c-4625-5188-a95e-2cd3bc29cb31 with identifier: DX86501
2026-03-30 05:32:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f3004c-4625-5188-a95e-2cd3bc29cb31 with scrape type 2
2026-03-30 05:32:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9f3004c-4625-5188-a95e-2cd3bc29cb31 with scrape type 2
2026-03-30 05:32:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9f3004c-4625-5188-a95e-2cd3bc29cb31, identifier: DX86501
2026-03-30 05:32:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9f3004c-4625-5188-a95e-2cd3bc29cb31 with identifier: DX86501
2026-03-30 05:32:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9f3004c-4625-5188-a95e-2cd3bc29cb31 with identifier: DX86501
2026-03-30 05:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9f3004c-4625-5188-a95e-2cd3bc29cb31 with identifier: DX86501 to the API
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:53Z',
 'fuel_type': 'diesel',
 'id': 'a9f3004c-4625-5188-a95e-2cd3bc29cb31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX86501',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 205022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-24',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2010}
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Saving data for DX86501: {'auction_closing_time': 1774883453.0, 'created_time': 1774350193.244198, 'last_price_update_time': 1774848758.216012}
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX86501') HTTP/1.1" 204 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for XY94981: 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for SA69574: 2
2026-03-30 05:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with identifier: SA69574
2026-03-30 05:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with scrape type 2
2026-03-30 05:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with scrape type 2
2026-03-30 05:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1, identifier: SA69574
2026-03-30 05:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with identifier: SA69574
2026-03-30 05:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with identifier: SA69574
2026-03-30 05:32:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1 with identifier: SA69574 to the API
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:46:21Z',
 'fuel_type': 'petrol',
 'id': 'c1fc8cc6-b3f2-5367-9be2-297a55a6f6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA69574',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 139549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Saving data for SA69574: {'auction_closing_time': 1774885581.0, 'created_time': 1773227252.772212, 'last_price_update_time': 1774848758.700746}
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA69574') HTTP/1.1" 204 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-30 05:32:38 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-30 05:32:38 [auto1.de] INFO: Scrape type for JH65606: 2
2026-03-30 05:32:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19cf6715-167a-5422-a58c-01ba36c09714 with identifier: JH65606
2026-03-30 05:32:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19cf6715-167a-5422-a58c-01ba36c09714 with scrape type 2
2026-03-30 05:32:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19cf6715-167a-5422-a58c-01ba36c09714 with scrape type 2
2026-03-30 05:32:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19cf6715-167a-5422-a58c-01ba36c09714, identifier: JH65606
2026-03-30 05:32:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19cf6715-167a-5422-a58c-01ba36c09714 with identifier: JH65606
2026-03-30 05:32:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19cf6715-167a-5422-a58c-01ba36c09714 with identifier: JH65606
2026-03-30 05:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19cf6715-167a-5422-a58c-01ba36c09714 with identifier: JH65606 to the API
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:19:37Z',
 'fuel_type': 'petrol',
 'id': '19cf6715-167a-5422-a58c-01ba36c09714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH65606',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 142395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2020}
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Saving data for JH65606: {'auction_closing_time': 1774883977.0, 'created_time': 1773830310.107827, 'last_price_update_time': 1774848759.224043}
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH65606') HTTP/1.1" 204 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for DR66726: 2
2026-03-30 05:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with identifier: DR66726
2026-03-30 05:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with scrape type 2
2026-03-30 05:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with scrape type 2
2026-03-30 05:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a297ad4a-4546-5b1a-8fa3-9a47fc5d5807, identifier: DR66726
2026-03-30 05:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with identifier: DR66726
2026-03-30 05:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with identifier: DR66726
2026-03-30 05:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a297ad4a-4546-5b1a-8fa3-9a47fc5d5807 with identifier: DR66726 to the API
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:02:19Z',
 'fuel_type': 'petrol',
 'id': 'a297ad4a-4546-5b1a-8fa3-9a47fc5d5807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR66726',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 319314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2011}
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Saving data for DR66726: {'auction_closing_time': 1774882939.0, 'created_time': 1774637247.037988, 'last_price_update_time': 1774848759.675391}
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR66726') HTTP/1.1" 204 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-30 05:32:39 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-30 05:32:39 [auto1.de] INFO: Scrape type for WL40040: 2
2026-03-30 05:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3918849-8763-5a8f-9baa-95b6125fbd2d with identifier: WL40040
2026-03-30 05:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3918849-8763-5a8f-9baa-95b6125fbd2d with scrape type 2
2026-03-30 05:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3918849-8763-5a8f-9baa-95b6125fbd2d with scrape type 2
2026-03-30 05:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3918849-8763-5a8f-9baa-95b6125fbd2d, identifier: WL40040
2026-03-30 05:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3918849-8763-5a8f-9baa-95b6125fbd2d with identifier: WL40040
2026-03-30 05:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3918849-8763-5a8f-9baa-95b6125fbd2d with identifier: WL40040
2026-03-30 05:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3918849-8763-5a8f-9baa-95b6125fbd2d with identifier: WL40040 to the API
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:29Z',
 'fuel_type': 'petrol',
 'id': 'a3918849-8763-5a8f-9baa-95b6125fbd2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL40040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 74031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-24',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Saving data for WL40040: {'auction_closing_time': 1774883849.0, 'created_time': 1774549835.280693, 'last_price_update_time': 1774848760.277264}
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL40040') HTTP/1.1" 204 0
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Scrape type for YK88723: 2
2026-03-30 05:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c62eb1a-20ec-56d8-a154-de429e36256a with identifier: YK88723
2026-03-30 05:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c62eb1a-20ec-56d8-a154-de429e36256a with scrape type 2
2026-03-30 05:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c62eb1a-20ec-56d8-a154-de429e36256a with scrape type 2
2026-03-30 05:32:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c62eb1a-20ec-56d8-a154-de429e36256a, identifier: YK88723
2026-03-30 05:32:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c62eb1a-20ec-56d8-a154-de429e36256a with identifier: YK88723
2026-03-30 05:32:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c62eb1a-20ec-56d8-a154-de429e36256a with identifier: YK88723
2026-03-30 05:32:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c62eb1a-20ec-56d8-a154-de429e36256a with identifier: YK88723 to the API
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:11:56Z',
 'fuel_type': 'petrol',
 'id': '1c62eb1a-20ec-56d8-a154-de429e36256a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK88723',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 111927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-24',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2013}
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Saving data for YK88723: {'auction_closing_time': 1774883516.0, 'created_time': 1774636279.367798, 'last_price_update_time': 1774848760.70719}
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK88723') HTTP/1.1" 204 0
2026-03-30 05:32:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:40 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 05:32:40 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-30 05:32:40 [auto1.de] INFO: Scrape type for TF89419: 2
2026-03-30 05:32:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-30 05:32:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf8c203-9a5f-5e02-afb5-18025b5e525c with scrape type 2
2026-03-30 05:32:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf8c203-9a5f-5e02-afb5-18025b5e525c with scrape type 2
2026-03-30 05:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf8c203-9a5f-5e02-afb5-18025b5e525c, identifier: TF89419
2026-03-30 05:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-30 05:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419
2026-03-30 05:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf8c203-9a5f-5e02-afb5-18025b5e525c with identifier: TF89419 to the API
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:18:33Z',
 'fuel_type': 'petrol',
 'id': 'cbf8c203-9a5f-5e02-afb5-18025b5e525c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF89419',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 40221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-23',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2022}
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Saving data for TF89419: {'auction_closing_time': 1774883913.0, 'created_time': 1773946255.713134, 'last_price_update_time': 1774848761.359849}
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF89419') HTTP/1.1" 204 0
2026-03-30 05:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for MR23018: 0
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for HP87000: 2
2026-03-30 05:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with identifier: HP87000
2026-03-30 05:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with scrape type 2
2026-03-30 05:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with scrape type 2
2026-03-30 05:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1bab6-c54f-5e9d-b341-01bb905b8201, identifier: HP87000
2026-03-30 05:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with identifier: HP87000
2026-03-30 05:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with identifier: HP87000
2026-03-30 05:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1bab6-c54f-5e9d-b341-01bb905b8201 with identifier: HP87000 to the API
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:41:37Z',
 'fuel_type': 'petrol',
 'id': '4ba1bab6-c54f-5e9d-b341-01bb905b8201',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP87000',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 17456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Saving data for HP87000: {'auction_closing_time': 1774885297.0, 'created_time': 1774521381.296103, 'last_price_update_time': 1774848761.831711}
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP87000') HTTP/1.1" 204 0
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-30 05:32:41 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-30 05:32:41 [auto1.de] INFO: Scrape type for HZ35615: 2
2026-03-30 05:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de6f8d99-0141-530b-bda1-1d6348e9d0ce with identifier: HZ35615
2026-03-30 05:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de6f8d99-0141-530b-bda1-1d6348e9d0ce with scrape type 2
2026-03-30 05:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de6f8d99-0141-530b-bda1-1d6348e9d0ce with scrape type 2
2026-03-30 05:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de6f8d99-0141-530b-bda1-1d6348e9d0ce, identifier: HZ35615
2026-03-30 05:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de6f8d99-0141-530b-bda1-1d6348e9d0ce with identifier: HZ35615
2026-03-30 05:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de6f8d99-0141-530b-bda1-1d6348e9d0ce with identifier: HZ35615
2026-03-30 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de6f8d99-0141-530b-bda1-1d6348e9d0ce with identifier: HZ35615 to the API
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:58:24Z',
 'fuel_type': 'petrol',
 'id': 'de6f8d99-0141-530b-bda1-1d6348e9d0ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ35615',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 29434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2016}
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Saving data for HZ35615: {'auction_closing_time': 1774886304.0, 'created_time': 1774636321.581709, 'last_price_update_time': 1774848762.324529}
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ35615') HTTP/1.1" 204 0
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Scrape type for ER42295: 2
2026-03-30 05:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65a6d023-afba-59fc-aab1-218d959a8379 with identifier: ER42295
2026-03-30 05:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65a6d023-afba-59fc-aab1-218d959a8379 with scrape type 2
2026-03-30 05:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65a6d023-afba-59fc-aab1-218d959a8379 with scrape type 2
2026-03-30 05:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65a6d023-afba-59fc-aab1-218d959a8379, identifier: ER42295
2026-03-30 05:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65a6d023-afba-59fc-aab1-218d959a8379 with identifier: ER42295
2026-03-30 05:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65a6d023-afba-59fc-aab1-218d959a8379 with identifier: ER42295
2026-03-30 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65a6d023-afba-59fc-aab1-218d959a8379 with identifier: ER42295 to the API
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'diesel',
 'id': '65a6d023-afba-59fc-aab1-218d959a8379',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER42295',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 168429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-29',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Saving data for ER42295: {'auction_closing_time': 1774884714.0, 'created_time': 1772544156.292388, 'last_price_update_time': 1774848762.75091}
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER42295') HTTP/1.1" 204 0
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Scrape type for SL53901: 0
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-30 05:32:42 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-30 05:32:42 [auto1.de] INFO: Scrape type for DC59357: 2
2026-03-30 05:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7415f437-2672-51c2-ba8a-9e4b776fdc58 with identifier: DC59357
2026-03-30 05:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7415f437-2672-51c2-ba8a-9e4b776fdc58 with scrape type 2
2026-03-30 05:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7415f437-2672-51c2-ba8a-9e4b776fdc58 with scrape type 2
2026-03-30 05:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7415f437-2672-51c2-ba8a-9e4b776fdc58, identifier: DC59357
2026-03-30 05:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7415f437-2672-51c2-ba8a-9e4b776fdc58 with identifier: DC59357
2026-03-30 05:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7415f437-2672-51c2-ba8a-9e4b776fdc58 with identifier: DC59357
2026-03-30 05:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7415f437-2672-51c2-ba8a-9e4b776fdc58 with identifier: DC59357 to the API
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:45Z',
 'fuel_type': 'diesel',
 'id': '7415f437-2672-51c2-ba8a-9e4b776fdc58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC59357',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 184554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-30 05:32:43 [auto1.de] INFO: Saving data for DC59357: {'auction_closing_time': 1774883925.0, 'created_time': 1774638148.664953, 'last_price_update_time': 1774848763.196831}
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC59357') HTTP/1.1" 204 0
2026-03-30 05:32:43 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-30 05:32:43 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-30 05:32:43 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-30 05:32:43 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-30 05:32:43 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-30 05:32:43 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-30 05:32:43 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-30 05:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:44 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Scrape type for KV36004: 0
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Scrape type for LD15809: 2
2026-03-30 05:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with identifier: LD15809
2026-03-30 05:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with scrape type 2
2026-03-30 05:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with scrape type 2
2026-03-30 05:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44ddef38-9220-5eb2-a4ab-da582dcf05c0, identifier: LD15809
2026-03-30 05:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with identifier: LD15809
2026-03-30 05:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with identifier: LD15809
2026-03-30 05:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44ddef38-9220-5eb2-a4ab-da582dcf05c0 with identifier: LD15809 to the API
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:31:03Z',
 'fuel_type': 'diesel',
 'id': '44ddef38-9220-5eb2-a4ab-da582dcf05c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD15809',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 85346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Active 2WD',
 'transmission': 'automatic',
 'trim': 'Active 2WD',
 'year': 2021}
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Saving data for LD15809: {'auction_closing_time': 1774884663.0, 'created_time': 1773225430.280001, 'last_price_update_time': 1774848764.567606}
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD15809') HTTP/1.1" 204 0
2026-03-30 05:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-30 05:32:44 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Scrape type for JZ25562: 2
2026-03-30 05:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with identifier: JZ25562
2026-03-30 05:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with scrape type 2
2026-03-30 05:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with scrape type 2
2026-03-30 05:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aca54d4b-e8c5-591e-9d12-9cea4a7fd895, identifier: JZ25562
2026-03-30 05:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with identifier: JZ25562
2026-03-30 05:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with identifier: JZ25562
2026-03-30 05:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aca54d4b-e8c5-591e-9d12-9cea4a7fd895 with identifier: JZ25562 to the API
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:16Z',
 'fuel_type': 'petrol',
 'id': 'aca54d4b-e8c5-591e-9d12-9cea4a7fd895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ25562',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 131763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-15',
 'seller_name': None,
 'title': 'BMW 4er 420i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-30 05:32:44 [auto1.de] INFO: Saving data for JZ25562: {'auction_closing_time': 1774883296.0, 'created_time': 1774636452.15965, 'last_price_update_time': 1774848764.979207}
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ25562') HTTP/1.1" 204 0
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-30 05:32:45 [auto1.de] INFO: Scrape type for ZF74811: 2
2026-03-30 05:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 896be54a-9129-54e9-aba0-627ad9c4e273 with identifier: ZF74811
2026-03-30 05:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 896be54a-9129-54e9-aba0-627ad9c4e273 with scrape type 2
2026-03-30 05:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 896be54a-9129-54e9-aba0-627ad9c4e273 with scrape type 2
2026-03-30 05:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 896be54a-9129-54e9-aba0-627ad9c4e273, identifier: ZF74811
2026-03-30 05:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 896be54a-9129-54e9-aba0-627ad9c4e273 with identifier: ZF74811
2026-03-30 05:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 896be54a-9129-54e9-aba0-627ad9c4e273 with identifier: ZF74811
2026-03-30 05:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 896be54a-9129-54e9-aba0-627ad9c4e273 with identifier: ZF74811 to the API
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:03:07Z',
 'fuel_type': 'petrol',
 'id': '896be54a-9129-54e9-aba0-627ad9c4e273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF74811',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 88790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-30 05:32:45 [auto1.de] INFO: Saving data for ZF74811: {'auction_closing_time': 1774882987.0, 'created_time': 1774639467.087439, 'last_price_update_time': 1774848765.47285}
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF74811') HTTP/1.1" 204 0
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-30 05:32:45 [auto1.de] INFO: Scrape type for KE98572: 2
2026-03-30 05:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 859bda06-2fe3-5063-a850-cf8d727f2ecd with identifier: KE98572
2026-03-30 05:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 859bda06-2fe3-5063-a850-cf8d727f2ecd with scrape type 2
2026-03-30 05:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 859bda06-2fe3-5063-a850-cf8d727f2ecd with scrape type 2
2026-03-30 05:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 859bda06-2fe3-5063-a850-cf8d727f2ecd, identifier: KE98572
2026-03-30 05:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 859bda06-2fe3-5063-a850-cf8d727f2ecd with identifier: KE98572
2026-03-30 05:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 859bda06-2fe3-5063-a850-cf8d727f2ecd with identifier: KE98572
2026-03-30 05:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 859bda06-2fe3-5063-a850-cf8d727f2ecd with identifier: KE98572 to the API
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:40Z',
 'fuel_type': 'petrol',
 'id': '859bda06-2fe3-5063-a850-cf8d727f2ecd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE98572',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 120386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-19',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'manual',
 'trim': 'Edition M Sport Shadow',
 'year': 2017}
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-30 05:32:45 [auto1.de] INFO: Saving data for KE98572: {'auction_closing_time': 1774884880.0, 'created_time': 1773304896.777117, 'last_price_update_time': 1774848765.958259}
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE98572') HTTP/1.1" 204 0
2026-03-30 05:32:45 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-30 05:32:45 [auto1.de] INFO: Scrape type for EX84018: 2
2026-03-30 05:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ece33fe-59e3-5074-949c-1a13724e476d with identifier: EX84018
2026-03-30 05:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ece33fe-59e3-5074-949c-1a13724e476d with scrape type 2
2026-03-30 05:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ece33fe-59e3-5074-949c-1a13724e476d with scrape type 2
2026-03-30 05:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ece33fe-59e3-5074-949c-1a13724e476d, identifier: EX84018
2026-03-30 05:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ece33fe-59e3-5074-949c-1a13724e476d with identifier: EX84018
2026-03-30 05:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ece33fe-59e3-5074-949c-1a13724e476d with identifier: EX84018
2026-03-30 05:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ece33fe-59e3-5074-949c-1a13724e476d with identifier: EX84018 to the API
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:31Z',
 'fuel_type': 'diesel',
 'id': '3ece33fe-59e3-5074-949c-1a13724e476d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX84018',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 168690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Saving data for EX84018: {'auction_closing_time': 1774883911.0, 'created_time': 1774639207.931771, 'last_price_update_time': 1774848766.368938}
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX84018') HTTP/1.1" 204 0
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Scrape type for AL93555: 2
2026-03-30 05:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with identifier: AL93555
2026-03-30 05:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with scrape type 2
2026-03-30 05:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with scrape type 2
2026-03-30 05:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e1428d1-ce8b-52b2-99c7-2d02b3810fae, identifier: AL93555
2026-03-30 05:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with identifier: AL93555
2026-03-30 05:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with identifier: AL93555
2026-03-30 05:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e1428d1-ce8b-52b2-99c7-2d02b3810fae with identifier: AL93555 to the API
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:11Z',
 'fuel_type': 'petrol',
 'id': '0e1428d1-ce8b-52b2-99c7-2d02b3810fae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL93555',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 119280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Saving data for AL93555: {'auction_closing_time': 1774885271.0, 'created_time': 1773917257.245094, 'last_price_update_time': 1774848766.863641}
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL93555') HTTP/1.1" 204 0
2026-03-30 05:32:46 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-30 05:32:46 [auto1.de] INFO: Scrape type for WE09519: 2
2026-03-30 05:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24783587-e0ad-5b3b-b464-a5bc47e5d245 with identifier: WE09519
2026-03-30 05:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24783587-e0ad-5b3b-b464-a5bc47e5d245 with scrape type 2
2026-03-30 05:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24783587-e0ad-5b3b-b464-a5bc47e5d245 with scrape type 2
2026-03-30 05:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24783587-e0ad-5b3b-b464-a5bc47e5d245, identifier: WE09519
2026-03-30 05:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24783587-e0ad-5b3b-b464-a5bc47e5d245 with identifier: WE09519
2026-03-30 05:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24783587-e0ad-5b3b-b464-a5bc47e5d245 with identifier: WE09519
2026-03-30 05:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24783587-e0ad-5b3b-b464-a5bc47e5d245 with identifier: WE09519 to the API
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:22:06Z',
 'fuel_type': 'petrol',
 'id': '24783587-e0ad-5b3b-b464-a5bc47e5d245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE09519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 125166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-03',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Saving data for WE09519: {'auction_closing_time': 1774884126.0, 'created_time': 1773830848.86126, 'last_price_update_time': 1774848767.367424}
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE09519') HTTP/1.1" 204 0
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Scrape type for CF84548: 0
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Scrape type for SX95086: 2
2026-03-30 05:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c0673cd-8bc7-5171-b77f-d797513d6718 with identifier: SX95086
2026-03-30 05:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c0673cd-8bc7-5171-b77f-d797513d6718 with scrape type 2
2026-03-30 05:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c0673cd-8bc7-5171-b77f-d797513d6718 with scrape type 2
2026-03-30 05:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c0673cd-8bc7-5171-b77f-d797513d6718, identifier: SX95086
2026-03-30 05:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c0673cd-8bc7-5171-b77f-d797513d6718 with identifier: SX95086
2026-03-30 05:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c0673cd-8bc7-5171-b77f-d797513d6718 with identifier: SX95086
2026-03-30 05:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c0673cd-8bc7-5171-b77f-d797513d6718 with identifier: SX95086 to the API
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:23:51Z',
 'fuel_type': 'petrol',
 'id': '5c0673cd-8bc7-5171-b77f-d797513d6718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX95086',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 217121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Saving data for SX95086: {'auction_closing_time': 1774884231.0, 'created_time': 1773830238.570521, 'last_price_update_time': 1774848767.821609}
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX95086') HTTP/1.1" 204 0
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-30 05:32:47 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-30 05:32:47 [auto1.de] INFO: Scrape type for NS14523: 2
2026-03-30 05:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be11c715-506d-58b4-92e1-017e21a8adc2 with identifier: NS14523
2026-03-30 05:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be11c715-506d-58b4-92e1-017e21a8adc2 with scrape type 2
2026-03-30 05:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be11c715-506d-58b4-92e1-017e21a8adc2 with scrape type 2
2026-03-30 05:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be11c715-506d-58b4-92e1-017e21a8adc2, identifier: NS14523
2026-03-30 05:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be11c715-506d-58b4-92e1-017e21a8adc2 with identifier: NS14523
2026-03-30 05:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be11c715-506d-58b4-92e1-017e21a8adc2 with identifier: NS14523
2026-03-30 05:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be11c715-506d-58b4-92e1-017e21a8adc2 with identifier: NS14523 to the API
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'petrol',
 'id': 'be11c715-506d-58b4-92e1-017e21a8adc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14523',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-07',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2014}
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Saving data for NS14523: {'auction_closing_time': 1774883705.0, 'created_time': 1774638808.016066, 'last_price_update_time': 1774848768.259351}
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS14523') HTTP/1.1" 204 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for TD06456: 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for XT71149: 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for NU38157: 2
2026-03-30 05:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7c4676-712a-501f-b13e-0fa8b6b99cdc with identifier: NU38157
2026-03-30 05:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7c4676-712a-501f-b13e-0fa8b6b99cdc with scrape type 2
2026-03-30 05:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7c4676-712a-501f-b13e-0fa8b6b99cdc with scrape type 2
2026-03-30 05:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac7c4676-712a-501f-b13e-0fa8b6b99cdc, identifier: NU38157
2026-03-30 05:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac7c4676-712a-501f-b13e-0fa8b6b99cdc with identifier: NU38157
2026-03-30 05:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac7c4676-712a-501f-b13e-0fa8b6b99cdc with identifier: NU38157
2026-03-30 05:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac7c4676-712a-501f-b13e-0fa8b6b99cdc with identifier: NU38157 to the API
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:51:22Z',
 'fuel_type': 'diesel',
 'id': 'ac7c4676-712a-501f-b13e-0fa8b6b99cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU38157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 146670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-18',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2016}
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Saving data for NU38157: {'auction_closing_time': 1774885882.0, 'created_time': 1773945846.794281, 'last_price_update_time': 1774848768.720664}
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU38157') HTTP/1.1" 204 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-30 05:32:48 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-30 05:32:48 [auto1.de] INFO: Scrape type for AB72988: 2
2026-03-30 05:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa0742f3-68d6-5d07-a91a-d27aa06bd5be with identifier: AB72988
2026-03-30 05:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa0742f3-68d6-5d07-a91a-d27aa06bd5be with scrape type 2
2026-03-30 05:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa0742f3-68d6-5d07-a91a-d27aa06bd5be with scrape type 2
2026-03-30 05:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa0742f3-68d6-5d07-a91a-d27aa06bd5be, identifier: AB72988
2026-03-30 05:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa0742f3-68d6-5d07-a91a-d27aa06bd5be with identifier: AB72988
2026-03-30 05:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa0742f3-68d6-5d07-a91a-d27aa06bd5be with identifier: AB72988
2026-03-30 05:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa0742f3-68d6-5d07-a91a-d27aa06bd5be with identifier: AB72988 to the API
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:55:29Z',
 'fuel_type': 'diesel',
 'id': 'fa0742f3-68d6-5d07-a91a-d27aa06bd5be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB72988',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 165523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'BMW 1er 123d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-30 05:32:49 [auto1.de] INFO: Saving data for AB72988: {'auction_closing_time': 1774886129.0, 'created_time': 1773905435.550547, 'last_price_update_time': 1774848769.272844}
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB72988') HTTP/1.1" 204 0
2026-03-30 05:32:49 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-30 05:32:49 [auto1.de] INFO: Scrape type for LJ53831: 2
2026-03-30 05:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cee635f-4030-5036-9743-a2da72fcf61c with identifier: LJ53831
2026-03-30 05:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cee635f-4030-5036-9743-a2da72fcf61c with scrape type 2
2026-03-30 05:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cee635f-4030-5036-9743-a2da72fcf61c with scrape type 2
2026-03-30 05:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cee635f-4030-5036-9743-a2da72fcf61c, identifier: LJ53831
2026-03-30 05:32:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cee635f-4030-5036-9743-a2da72fcf61c with identifier: LJ53831
2026-03-30 05:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cee635f-4030-5036-9743-a2da72fcf61c with identifier: LJ53831
2026-03-30 05:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cee635f-4030-5036-9743-a2da72fcf61c with identifier: LJ53831 to the API
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:24Z',
 'fuel_type': 'petrol',
 'id': '5cee635f-4030-5036-9743-a2da72fcf61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ53831',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 43745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Go 2WD',
 'transmission': 'manual',
 'trim': 'Go 2WD',
 'year': 2023}
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-30 05:32:49 [auto1.de] INFO: Saving data for LJ53831: {'auction_closing_time': 1774885584.0, 'created_time': 1774639075.289314, 'last_price_update_time': 1774848769.664693}
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ53831') HTTP/1.1" 204 0
2026-03-30 05:32:49 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:49 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-30 05:32:49 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-30 05:32:49 [auto1.de] INFO: Scrape type for UL11203: 2
2026-03-30 05:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b128704-48aa-5c3d-83a8-145930ee2451 with identifier: UL11203
2026-03-30 05:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b128704-48aa-5c3d-83a8-145930ee2451 with scrape type 2
2026-03-30 05:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b128704-48aa-5c3d-83a8-145930ee2451 with scrape type 2
2026-03-30 05:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b128704-48aa-5c3d-83a8-145930ee2451, identifier: UL11203
2026-03-30 05:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b128704-48aa-5c3d-83a8-145930ee2451 with identifier: UL11203
2026-03-30 05:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b128704-48aa-5c3d-83a8-145930ee2451 with identifier: UL11203
2026-03-30 05:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b128704-48aa-5c3d-83a8-145930ee2451 with identifier: UL11203 to the API
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:00:58Z',
 'fuel_type': 'petrol',
 'id': '1b128704-48aa-5c3d-83a8-145930ee2451',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL11203',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 126932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2011}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Saving data for UL11203: {'auction_closing_time': 1774882858.0, 'created_time': 1774637215.745263, 'last_price_update_time': 1774848770.093777}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL11203') HTTP/1.1" 204 0
2026-03-30 05:32:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:50 [auto1.de] INFO: Found listing with ID: US43373
2026-03-30 05:32:50 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Scrape type for ZL30949: 2
2026-03-30 05:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce7337a4-4dab-5b64-bb39-518f0f37ed82 with identifier: ZL30949
2026-03-30 05:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce7337a4-4dab-5b64-bb39-518f0f37ed82 with scrape type 2
2026-03-30 05:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce7337a4-4dab-5b64-bb39-518f0f37ed82 with scrape type 2
2026-03-30 05:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce7337a4-4dab-5b64-bb39-518f0f37ed82, identifier: ZL30949
2026-03-30 05:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce7337a4-4dab-5b64-bb39-518f0f37ed82 with identifier: ZL30949
2026-03-30 05:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce7337a4-4dab-5b64-bb39-518f0f37ed82 with identifier: ZL30949
2026-03-30 05:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce7337a4-4dab-5b64-bb39-518f0f37ed82 with identifier: ZL30949 to the API
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'diesel',
 'id': 'ce7337a4-4dab-5b64-bb39-518f0f37ed82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL30949',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 157145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Saving data for ZL30949: {'auction_closing_time': 1774884352.0, 'created_time': 1774636625.078098, 'last_price_update_time': 1774848770.49894}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL30949') HTTP/1.1" 204 0
2026-03-30 05:32:50 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Scrape type for BA31495: 2
2026-03-30 05:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with identifier: BA31495
2026-03-30 05:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with scrape type 2
2026-03-30 05:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with scrape type 2
2026-03-30 05:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a9588b6-c1f9-59f8-9de4-02c6bce3a252, identifier: BA31495
2026-03-30 05:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with identifier: BA31495
2026-03-30 05:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with identifier: BA31495
2026-03-30 05:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a9588b6-c1f9-59f8-9de4-02c6bce3a252 with identifier: BA31495 to the API
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:35Z',
 'fuel_type': 'petrol',
 'id': '9a9588b6-c1f9-59f8-9de4-02c6bce3a252',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA31495',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 129345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Saving data for BA31495: {'auction_closing_time': 1774884395.0, 'created_time': 1774639466.070998, 'last_price_update_time': 1774848770.8954}
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA31495') HTTP/1.1" 204 0
2026-03-30 05:32:50 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-30 05:32:50 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-30 05:32:50 [auto1.de] INFO: Scrape type for AE93045: 2
2026-03-30 05:32:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with identifier: AE93045
2026-03-30 05:32:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with scrape type 2
2026-03-30 05:32:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with scrape type 2
2026-03-30 05:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4971e40e-a5fc-5a1a-9bef-7ed87c009fea, identifier: AE93045
2026-03-30 05:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with identifier: AE93045
2026-03-30 05:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with identifier: AE93045
2026-03-30 05:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4971e40e-a5fc-5a1a-9bef-7ed87c009fea with identifier: AE93045 to the API
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:59:11Z',
 'fuel_type': 'diesel',
 'id': '4971e40e-a5fc-5a1a-9bef-7ed87c009fea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE93045',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 91387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2019}
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Saving data for AE93045: {'auction_closing_time': 1774886351.0, 'created_time': 1774637929.858649, 'last_price_update_time': 1774848771.29262}
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE93045') HTTP/1.1" 204 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for BZ78567: 2
2026-03-30 05:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a029133-4830-536a-bccd-3ce1b81d96f1 with identifier: BZ78567
2026-03-30 05:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a029133-4830-536a-bccd-3ce1b81d96f1 with scrape type 2
2026-03-30 05:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a029133-4830-536a-bccd-3ce1b81d96f1 with scrape type 2
2026-03-30 05:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a029133-4830-536a-bccd-3ce1b81d96f1, identifier: BZ78567
2026-03-30 05:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a029133-4830-536a-bccd-3ce1b81d96f1 with identifier: BZ78567
2026-03-30 05:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a029133-4830-536a-bccd-3ce1b81d96f1 with identifier: BZ78567
2026-03-30 05:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a029133-4830-536a-bccd-3ce1b81d96f1 with identifier: BZ78567 to the API
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:10:22Z',
 'fuel_type': 'diesel',
 'id': '8a029133-4830-536a-bccd-3ce1b81d96f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ78567',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 230255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend Edition',
 'transmission': 'automatic',
 'trim': 'lang Trend Edition',
 'year': 2012}
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Saving data for BZ78567: {'auction_closing_time': 1774883422.0, 'created_time': 1774637658.779269, 'last_price_update_time': 1774848771.810384}
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ78567') HTTP/1.1" 204 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for WG96363: 0
2026-03-30 05:32:51 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-30 05:32:51 [auto1.de] INFO: Scrape type for PS52652: 2
2026-03-30 05:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fb45d0f-2237-507b-84e2-815b63489e5d with identifier: PS52652
2026-03-30 05:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fb45d0f-2237-507b-84e2-815b63489e5d with scrape type 2
2026-03-30 05:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fb45d0f-2237-507b-84e2-815b63489e5d with scrape type 2
2026-03-30 05:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fb45d0f-2237-507b-84e2-815b63489e5d, identifier: PS52652
2026-03-30 05:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fb45d0f-2237-507b-84e2-815b63489e5d with identifier: PS52652
2026-03-30 05:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fb45d0f-2237-507b-84e2-815b63489e5d with identifier: PS52652
2026-03-30 05:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fb45d0f-2237-507b-84e2-815b63489e5d with identifier: PS52652 to the API
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:43:27Z',
 'fuel_type': 'petrol',
 'id': '6fb45d0f-2237-507b-84e2-815b63489e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS52652',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 116481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-06',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 B-Cool Snow 4x4',
 'transmission': 'manual',
 'trim': 'B-Cool Snow 4x4',
 'year': 2016}
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Saving data for PS52652: {'auction_closing_time': 1774885407.0, 'created_time': 1774349932.346299, 'last_price_update_time': 1774848772.284697}
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS52652') HTTP/1.1" 204 0
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Scrape type for MU77879: 2
2026-03-30 05:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd034f49-7451-5d7a-b31a-31f40708d866 with identifier: MU77879
2026-03-30 05:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd034f49-7451-5d7a-b31a-31f40708d866 with scrape type 2
2026-03-30 05:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd034f49-7451-5d7a-b31a-31f40708d866 with scrape type 2
2026-03-30 05:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd034f49-7451-5d7a-b31a-31f40708d866, identifier: MU77879
2026-03-30 05:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd034f49-7451-5d7a-b31a-31f40708d866 with identifier: MU77879
2026-03-30 05:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd034f49-7451-5d7a-b31a-31f40708d866 with identifier: MU77879
2026-03-30 05:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd034f49-7451-5d7a-b31a-31f40708d866 with identifier: MU77879 to the API
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:38Z',
 'fuel_type': 'diesel',
 'id': 'fd034f49-7451-5d7a-b31a-31f40708d866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU77879',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 333346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-29',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Saving data for MU77879: {'auction_closing_time': 1774884458.0, 'created_time': 1774638545.455083, 'last_price_update_time': 1774848772.693219}
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU77879') HTTP/1.1" 204 0
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Scrape type for VJ44121: 0
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-30 05:32:52 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-30 05:32:52 [auto1.de] INFO: Scrape type for DW77262: 2
2026-03-30 05:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d44818fc-b493-5aff-92b6-3d7593eae4dc with identifier: DW77262
2026-03-30 05:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d44818fc-b493-5aff-92b6-3d7593eae4dc with scrape type 2
2026-03-30 05:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d44818fc-b493-5aff-92b6-3d7593eae4dc with scrape type 2
2026-03-30 05:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d44818fc-b493-5aff-92b6-3d7593eae4dc, identifier: DW77262
2026-03-30 05:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d44818fc-b493-5aff-92b6-3d7593eae4dc with identifier: DW77262
2026-03-30 05:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d44818fc-b493-5aff-92b6-3d7593eae4dc with identifier: DW77262
2026-03-30 05:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d44818fc-b493-5aff-92b6-3d7593eae4dc with identifier: DW77262 to the API
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:20Z',
 'fuel_type': 'diesel',
 'id': 'd44818fc-b493-5aff-92b6-3d7593eae4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77262',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 249515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2015}
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Saving data for DW77262: {'auction_closing_time': 1774883780.0, 'created_time': 1774549860.093203, 'last_price_update_time': 1774848773.240316}
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77262') HTTP/1.1" 204 0
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for FZ49091: 0
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for PW56805: 0
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 05:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:53 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for XB91859: 2
2026-03-30 05:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde6c6cc-da35-5058-a4d0-ea431c57f33d with identifier: XB91859
2026-03-30 05:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde6c6cc-da35-5058-a4d0-ea431c57f33d with scrape type 2
2026-03-30 05:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde6c6cc-da35-5058-a4d0-ea431c57f33d with scrape type 2
2026-03-30 05:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde6c6cc-da35-5058-a4d0-ea431c57f33d, identifier: XB91859
2026-03-30 05:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde6c6cc-da35-5058-a4d0-ea431c57f33d with identifier: XB91859
2026-03-30 05:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde6c6cc-da35-5058-a4d0-ea431c57f33d with identifier: XB91859
2026-03-30 05:32:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde6c6cc-da35-5058-a4d0-ea431c57f33d with identifier: XB91859 to the API
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'diesel',
 'id': 'cde6c6cc-da35-5058-a4d0-ea431c57f33d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB91859',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 166992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2016}
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Saving data for XB91859: {'auction_closing_time': 1774886205.0, 'created_time': 1774349971.062957, 'last_price_update_time': 1774848773.864918}
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB91859') HTTP/1.1" 204 0
2026-03-30 05:32:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:53 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-30 05:32:53 [auto1.de] INFO: Scrape type for UL81757: 2
2026-03-30 05:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba76fab7-0ca7-517a-bc47-ecf1254d930c with identifier: UL81757
2026-03-30 05:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba76fab7-0ca7-517a-bc47-ecf1254d930c with scrape type 2
2026-03-30 05:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba76fab7-0ca7-517a-bc47-ecf1254d930c with scrape type 2
2026-03-30 05:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba76fab7-0ca7-517a-bc47-ecf1254d930c, identifier: UL81757
2026-03-30 05:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba76fab7-0ca7-517a-bc47-ecf1254d930c with identifier: UL81757
2026-03-30 05:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba76fab7-0ca7-517a-bc47-ecf1254d930c with identifier: UL81757
2026-03-30 05:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba76fab7-0ca7-517a-bc47-ecf1254d930c with identifier: UL81757 to the API
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:41Z',
 'fuel_type': 'diesel',
 'id': 'ba76fab7-0ca7-517a-bc47-ecf1254d930c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL81757',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 44676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Saving data for UL81757: {'auction_closing_time': 1774884341.0, 'created_time': 1774639227.43769, 'last_price_update_time': 1774848774.390741}
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL81757') HTTP/1.1" 204 0
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Scrape type for HL01818: 2
2026-03-30 05:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with identifier: HL01818
2026-03-30 05:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with scrape type 2
2026-03-30 05:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with scrape type 2
2026-03-30 05:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bab24ee-2fa8-5803-806e-ec3d6045bc05, identifier: HL01818
2026-03-30 05:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with identifier: HL01818
2026-03-30 05:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with identifier: HL01818
2026-03-30 05:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bab24ee-2fa8-5803-806e-ec3d6045bc05 with identifier: HL01818 to the API
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:18:49Z',
 'fuel_type': 'petrol',
 'id': '5bab24ee-2fa8-5803-806e-ec3d6045bc05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL01818',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 58108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-20',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Saving data for HL01818: {'auction_closing_time': 1774883929.0, 'created_time': 1774637641.616488, 'last_price_update_time': 1774848774.798475}
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL01818') HTTP/1.1" 204 0
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-30 05:32:54 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-30 05:32:54 [auto1.de] INFO: Scrape type for HV61627: 2
2026-03-30 05:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d90374-bf21-5777-92b0-6a47a3f7f818 with identifier: HV61627
2026-03-30 05:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d90374-bf21-5777-92b0-6a47a3f7f818 with scrape type 2
2026-03-30 05:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d90374-bf21-5777-92b0-6a47a3f7f818 with scrape type 2
2026-03-30 05:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63d90374-bf21-5777-92b0-6a47a3f7f818, identifier: HV61627
2026-03-30 05:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63d90374-bf21-5777-92b0-6a47a3f7f818 with identifier: HV61627
2026-03-30 05:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63d90374-bf21-5777-92b0-6a47a3f7f818 with identifier: HV61627
2026-03-30 05:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63d90374-bf21-5777-92b0-6a47a3f7f818 with identifier: HV61627 to the API
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:19:20Z',
 'fuel_type': 'petrol',
 'id': '63d90374-bf21-5777-92b0-6a47a3f7f818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV61627',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 213533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-30 05:32:55 [auto1.de] INFO: Saving data for HV61627: {'auction_closing_time': 1774883960.0, 'created_time': 1774637069.376796, 'last_price_update_time': 1774848775.254225}
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV61627') HTTP/1.1" 204 0
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-30 05:32:55 [auto1.de] INFO: Scrape type for VJ57461: 2
2026-03-30 05:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98de8760-ba99-54ef-878c-1a631d13f076 with identifier: VJ57461
2026-03-30 05:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98de8760-ba99-54ef-878c-1a631d13f076 with scrape type 2
2026-03-30 05:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98de8760-ba99-54ef-878c-1a631d13f076 with scrape type 2
2026-03-30 05:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98de8760-ba99-54ef-878c-1a631d13f076, identifier: VJ57461
2026-03-30 05:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98de8760-ba99-54ef-878c-1a631d13f076 with identifier: VJ57461
2026-03-30 05:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98de8760-ba99-54ef-878c-1a631d13f076 with identifier: VJ57461
2026-03-30 05:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98de8760-ba99-54ef-878c-1a631d13f076 with identifier: VJ57461 to the API
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:59:19Z',
 'fuel_type': 'hybrid',
 'id': '98de8760-ba99-54ef-878c-1a631d13f076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ57461',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 45105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-16',
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-30 05:32:55 [auto1.de] INFO: Saving data for VJ57461: {'auction_closing_time': 1774886359.0, 'created_time': 1774638336.288541, 'last_price_update_time': 1774848775.6627}
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ57461') HTTP/1.1" 204 0
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-30 05:32:55 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-30 05:32:55 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-30 05:32:55 [auto1.de] INFO: Scrape type for KB43733: 2
2026-03-30 05:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2bccbbb-4b04-5599-9afc-dd396d152c04 with identifier: KB43733
2026-03-30 05:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2bccbbb-4b04-5599-9afc-dd396d152c04 with scrape type 2
2026-03-30 05:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2bccbbb-4b04-5599-9afc-dd396d152c04 with scrape type 2
2026-03-30 05:32:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2bccbbb-4b04-5599-9afc-dd396d152c04, identifier: KB43733
2026-03-30 05:32:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2bccbbb-4b04-5599-9afc-dd396d152c04 with identifier: KB43733
2026-03-30 05:32:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2bccbbb-4b04-5599-9afc-dd396d152c04 with identifier: KB43733
2026-03-30 05:32:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2bccbbb-4b04-5599-9afc-dd396d152c04 with identifier: KB43733 to the API
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:57Z',
 'fuel_type': 'diesel',
 'id': 'd2bccbbb-4b04-5599-9afc-dd396d152c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB43733',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 277555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-30 05:32:56 [auto1.de] INFO: Saving data for KB43733: {'auction_closing_time': 1774883757.0, 'created_time': 1773859769.7725, 'last_price_update_time': 1774848776.102604}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB43733') HTTP/1.1" 204 0
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-30 05:32:56 [auto1.de] INFO: Scrape type for XC13487: 2
2026-03-30 05:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f79138a-a3bb-50e9-9266-c681e57866d3 with identifier: XC13487
2026-03-30 05:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f79138a-a3bb-50e9-9266-c681e57866d3 with scrape type 2
2026-03-30 05:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f79138a-a3bb-50e9-9266-c681e57866d3 with scrape type 2
2026-03-30 05:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f79138a-a3bb-50e9-9266-c681e57866d3, identifier: XC13487
2026-03-30 05:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f79138a-a3bb-50e9-9266-c681e57866d3 with identifier: XC13487
2026-03-30 05:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f79138a-a3bb-50e9-9266-c681e57866d3 with identifier: XC13487
2026-03-30 05:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f79138a-a3bb-50e9-9266-c681e57866d3 with identifier: XC13487 to the API
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '9f79138a-a3bb-50e9-9266-c681e57866d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC13487',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 49207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-30 05:32:56 [auto1.de] INFO: Saving data for XC13487: {'auction_closing_time': 1774883065.0, 'created_time': 1774637220.915466, 'last_price_update_time': 1774848776.583459}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC13487') HTTP/1.1" 204 0
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-30 05:32:56 [auto1.de] INFO: Scrape type for JL05117: 2
2026-03-30 05:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with identifier: JL05117
2026-03-30 05:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with scrape type 2
2026-03-30 05:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with scrape type 2
2026-03-30 05:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5, identifier: JL05117
2026-03-30 05:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with identifier: JL05117
2026-03-30 05:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with identifier: JL05117
2026-03-30 05:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5 with identifier: JL05117 to the API
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'petrol',
 'id': 'e2c3a1e5-24e5-58d1-b9c2-9797cce0fae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL05117',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 26478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2023}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-30 05:32:56 [auto1.de] INFO: Saving data for JL05117: {'auction_closing_time': 1774886220.0, 'created_time': 1773917320.396341, 'last_price_update_time': 1774848776.980602}
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL05117') HTTP/1.1" 204 0
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 05:32:56 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-30 05:32:57 [auto1.de] INFO: Scrape type for AZ14861: 2
2026-03-30 05:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 796523a3-53ba-5c72-b44e-03f452f747c3 with identifier: AZ14861
2026-03-30 05:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 796523a3-53ba-5c72-b44e-03f452f747c3 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 796523a3-53ba-5c72-b44e-03f452f747c3 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 796523a3-53ba-5c72-b44e-03f452f747c3, identifier: AZ14861
2026-03-30 05:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 796523a3-53ba-5c72-b44e-03f452f747c3 with identifier: AZ14861
2026-03-30 05:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 796523a3-53ba-5c72-b44e-03f452f747c3 with identifier: AZ14861
2026-03-30 05:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 796523a3-53ba-5c72-b44e-03f452f747c3 with identifier: AZ14861 to the API
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:27Z',
 'fuel_type': 'diesel',
 'id': '796523a3-53ba-5c72-b44e-03f452f747c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ14861',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 111787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-31',
 'seller_name': None,
 'title': 'BMW 2er 218d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2020}
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-30 05:32:57 [auto1.de] INFO: Saving data for AZ14861: {'auction_closing_time': 1774882827.0, 'created_time': 1773132226.477041, 'last_price_update_time': 1774848777.38392}
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ14861') HTTP/1.1" 204 0
2026-03-30 05:32:57 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-30 05:32:57 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-30 05:32:57 [auto1.de] INFO: Scrape type for AZ92098: 2
2026-03-30 05:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3afb398-f75d-58b3-901d-161ecee899a8 with identifier: AZ92098
2026-03-30 05:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3afb398-f75d-58b3-901d-161ecee899a8 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3afb398-f75d-58b3-901d-161ecee899a8 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3afb398-f75d-58b3-901d-161ecee899a8, identifier: AZ92098
2026-03-30 05:32:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3afb398-f75d-58b3-901d-161ecee899a8 with identifier: AZ92098
2026-03-30 05:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3afb398-f75d-58b3-901d-161ecee899a8 with identifier: AZ92098
2026-03-30 05:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3afb398-f75d-58b3-901d-161ecee899a8 with identifier: AZ92098 to the API
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:31:36Z',
 'fuel_type': 'petrol',
 'id': 'e3afb398-f75d-58b3-901d-161ecee899a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ92098',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S90',
 'odometer': 22347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-04',
 'seller_name': None,
 'title': 'Volvo S90 2.0 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-30 05:32:57 [auto1.de] INFO: Saving data for AZ92098: {'auction_closing_time': 1774884696.0, 'created_time': 1774639038.241755, 'last_price_update_time': 1774848777.790568}
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ92098') HTTP/1.1" 204 0
2026-03-30 05:32:57 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 05:32:57 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-30 05:32:57 [auto1.de] INFO: Scrape type for JP14233: 2
2026-03-30 05:32:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383294c0-9419-5ce6-8c52-5204d03e3932 with identifier: JP14233
2026-03-30 05:32:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383294c0-9419-5ce6-8c52-5204d03e3932 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383294c0-9419-5ce6-8c52-5204d03e3932 with scrape type 2
2026-03-30 05:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 383294c0-9419-5ce6-8c52-5204d03e3932, identifier: JP14233
2026-03-30 05:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 383294c0-9419-5ce6-8c52-5204d03e3932 with identifier: JP14233
2026-03-30 05:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 383294c0-9419-5ce6-8c52-5204d03e3932 with identifier: JP14233
2026-03-30 05:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 383294c0-9419-5ce6-8c52-5204d03e3932 with identifier: JP14233 to the API
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:14Z',
 'fuel_type': 'petrol',
 'id': '383294c0-9419-5ce6-8c52-5204d03e3932',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP14233',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 98259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Audi A1 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-30 05:32:58 [auto1.de] INFO: Saving data for JP14233: {'auction_closing_time': 1774886174.0, 'created_time': 1774637118.005357, 'last_price_update_time': 1774848778.2002}
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP14233') HTTP/1.1" 204 0
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-30 05:32:58 [auto1.de] INFO: Scrape type for LU22691: 2
2026-03-30 05:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0603978-cdb7-51dc-8c58-5c6bd4346d09 with identifier: LU22691
2026-03-30 05:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0603978-cdb7-51dc-8c58-5c6bd4346d09 with scrape type 2
2026-03-30 05:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0603978-cdb7-51dc-8c58-5c6bd4346d09 with scrape type 2
2026-03-30 05:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0603978-cdb7-51dc-8c58-5c6bd4346d09, identifier: LU22691
2026-03-30 05:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0603978-cdb7-51dc-8c58-5c6bd4346d09 with identifier: LU22691
2026-03-30 05:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0603978-cdb7-51dc-8c58-5c6bd4346d09 with identifier: LU22691
2026-03-30 05:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0603978-cdb7-51dc-8c58-5c6bd4346d09 with identifier: LU22691 to the API
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'petrol',
 'id': 'e0603978-cdb7-51dc-8c58-5c6bd4346d09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU22691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 144620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-01',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-30 05:32:58 [auto1.de] INFO: Saving data for LU22691: {'auction_closing_time': 1774885975.0, 'created_time': 1774549881.734871, 'last_price_update_time': 1774848778.68472}
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU22691') HTTP/1.1" 204 0
2026-03-30 05:32:58 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6742 | hits on page: 40
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-30 05:32:58 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-30 05:32:58 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-30 05:32:58 [auto1.de] INFO: Scrape type for GA19207: 2
2026-03-30 05:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505cd9b2-2683-5631-8759-a621047f5ef6 with identifier: GA19207
2026-03-30 05:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505cd9b2-2683-5631-8759-a621047f5ef6 with scrape type 2
2026-03-30 05:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505cd9b2-2683-5631-8759-a621047f5ef6 with scrape type 2
2026-03-30 05:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 505cd9b2-2683-5631-8759-a621047f5ef6, identifier: GA19207
2026-03-30 05:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 505cd9b2-2683-5631-8759-a621047f5ef6 with identifier: GA19207
2026-03-30 05:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 505cd9b2-2683-5631-8759-a621047f5ef6 with identifier: GA19207
2026-03-30 05:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 505cd9b2-2683-5631-8759-a621047f5ef6 with identifier: GA19207 to the API
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:20:10Z',
 'fuel_type': 'diesel',
 'id': '505cd9b2-2683-5631-8759-a621047f5ef6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA19207',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 224869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-25',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI PanAmericana 4Motion',
 'transmission': 'automatic',
 'trim': 'PanAmericana 4Motion',
 'year': 2015}
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Saving data for GA19207: {'auction_closing_time': 1774884010.0, 'created_time': 1774549871.516882, 'last_price_update_time': 1774848779.192683}
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA19207') HTTP/1.1" 204 0
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Scrape type for HF53882: 2
2026-03-30 05:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-03-30 05:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694ab02c-2af8-5d79-a53c-4590e10a36dc with scrape type 2
2026-03-30 05:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694ab02c-2af8-5d79-a53c-4590e10a36dc with scrape type 2
2026-03-30 05:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 694ab02c-2af8-5d79-a53c-4590e10a36dc, identifier: HF53882
2026-03-30 05:32:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-30 05:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-03-30 05:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882
2026-03-30 05:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 694ab02c-2af8-5d79-a53c-4590e10a36dc with identifier: HF53882 to the API
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:58:06Z',
 'fuel_type': 'petrol',
 'id': '694ab02c-2af8-5d79-a53c-4590e10a36dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF53882',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 25395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Saving data for HF53882: {'auction_closing_time': 1774886286.0, 'created_time': 1773466836.852752, 'last_price_update_time': 1774848779.604058}
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF53882') HTTP/1.1" 204 0
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-30 05:32:59 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-30 05:32:59 [auto1.de] INFO: Scrape type for WN72573: 2
2026-03-30 05:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e83d53dc-392f-5907-9090-2d8d56dfed59 with identifier: WN72573
2026-03-30 05:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e83d53dc-392f-5907-9090-2d8d56dfed59 with scrape type 2
2026-03-30 05:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e83d53dc-392f-5907-9090-2d8d56dfed59 with scrape type 2
2026-03-30 05:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e83d53dc-392f-5907-9090-2d8d56dfed59, identifier: WN72573
2026-03-30 05:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e83d53dc-392f-5907-9090-2d8d56dfed59 with identifier: WN72573
2026-03-30 05:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e83d53dc-392f-5907-9090-2d8d56dfed59 with identifier: WN72573
2026-03-30 05:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e83d53dc-392f-5907-9090-2d8d56dfed59 with identifier: WN72573 to the API
2026-03-30 05:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:44Z',
 'fuel_type': 'diesel',
 'id': 'e83d53dc-392f-5907-9090-2d8d56dfed59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN72573',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 321736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-17',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 You!',
 'transmission': 'manual',
 'trim': 'You!',
 'year': 2013}
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Saving data for WN72573: {'auction_closing_time': 1774885364.0, 'created_time': 1774002105.028999, 'last_price_update_time': 1774848780.144747}
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN72573') HTTP/1.1" 204 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for GA77532: 2
2026-03-30 05:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 205e12c3-8fd7-53d8-9dd7-ba44e91520df with identifier: GA77532
2026-03-30 05:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205e12c3-8fd7-53d8-9dd7-ba44e91520df with scrape type 2
2026-03-30 05:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 205e12c3-8fd7-53d8-9dd7-ba44e91520df with scrape type 2
2026-03-30 05:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 205e12c3-8fd7-53d8-9dd7-ba44e91520df, identifier: GA77532
2026-03-30 05:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 205e12c3-8fd7-53d8-9dd7-ba44e91520df with identifier: GA77532
2026-03-30 05:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 205e12c3-8fd7-53d8-9dd7-ba44e91520df with identifier: GA77532
2026-03-30 05:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 205e12c3-8fd7-53d8-9dd7-ba44e91520df with identifier: GA77532 to the API
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'diesel',
 'id': '205e12c3-8fd7-53d8-9dd7-ba44e91520df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA77532',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 187695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Saving data for GA77532: {'auction_closing_time': 1774883859.0, 'created_time': 1773227249.494038, 'last_price_update_time': 1774848780.550271}
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA77532') HTTP/1.1" 204 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for DN26053: 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for PC60624: 0
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-30 05:33:00 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-30 05:33:00 [auto1.de] INFO: Scrape type for KH16310: 2
2026-03-30 05:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b30219-2403-53f4-88f6-3caa449362d0 with identifier: KH16310
2026-03-30 05:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b30219-2403-53f4-88f6-3caa449362d0 with scrape type 2
2026-03-30 05:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b30219-2403-53f4-88f6-3caa449362d0 with scrape type 2
2026-03-30 05:33:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30b30219-2403-53f4-88f6-3caa449362d0, identifier: KH16310
2026-03-30 05:33:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30b30219-2403-53f4-88f6-3caa449362d0 with identifier: KH16310
2026-03-30 05:33:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30b30219-2403-53f4-88f6-3caa449362d0 with identifier: KH16310
2026-03-30 05:33:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30b30219-2403-53f4-88f6-3caa449362d0 with identifier: KH16310 to the API
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:24Z',
 'fuel_type': 'diesel',
 'id': '30b30219-2403-53f4-88f6-3caa449362d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH16310',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 90851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Saving data for KH16310: {'auction_closing_time': 1774884144.0, 'created_time': 1774637780.656679, 'last_price_update_time': 1774848781.042682}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH16310') HTTP/1.1" 204 0
2026-03-30 05:33:01 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Scrape type for UH34905: 2
2026-03-30 05:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b83269dd-afcd-503b-896c-7719b4837c0a with identifier: UH34905
2026-03-30 05:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b83269dd-afcd-503b-896c-7719b4837c0a with scrape type 2
2026-03-30 05:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b83269dd-afcd-503b-896c-7719b4837c0a with scrape type 2
2026-03-30 05:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b83269dd-afcd-503b-896c-7719b4837c0a, identifier: UH34905
2026-03-30 05:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b83269dd-afcd-503b-896c-7719b4837c0a with identifier: UH34905
2026-03-30 05:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b83269dd-afcd-503b-896c-7719b4837c0a with identifier: UH34905
2026-03-30 05:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b83269dd-afcd-503b-896c-7719b4837c0a with identifier: UH34905 to the API
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'petrol',
 'id': 'b83269dd-afcd-503b-896c-7719b4837c0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH34905',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 89985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Saving data for UH34905: {'auction_closing_time': 1774884311.0, 'created_time': 1774549865.284603, 'last_price_update_time': 1774848781.547123}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH34905') HTTP/1.1" 204 0
2026-03-30 05:33:01 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Scrape type for NJ46216: 2
2026-03-30 05:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with identifier: NJ46216
2026-03-30 05:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with scrape type 2
2026-03-30 05:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with scrape type 2
2026-03-30 05:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e622b44-a767-5fb5-b7e2-3aadf8b44f17, identifier: NJ46216
2026-03-30 05:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with identifier: NJ46216
2026-03-30 05:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with identifier: NJ46216
2026-03-30 05:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e622b44-a767-5fb5-b7e2-3aadf8b44f17 with identifier: NJ46216 to the API
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:34:01Z',
 'fuel_type': 'petrol',
 'id': '1e622b44-a767-5fb5-b7e2-3aadf8b44f17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ46216',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 260014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2007}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Saving data for NJ46216: {'auction_closing_time': 1774884841.0, 'created_time': 1774638588.846332, 'last_price_update_time': 1774848781.951265}
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ46216') HTTP/1.1" 204 0
2026-03-30 05:33:01 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 05:33:01 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-30 05:33:01 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-30 05:33:01 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-30 05:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Scrape type for KE72170: 2
2026-03-30 05:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f081828-bedf-5df8-bf37-2468e76b29a4 with identifier: KE72170
2026-03-30 05:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f081828-bedf-5df8-bf37-2468e76b29a4 with scrape type 2
2026-03-30 05:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f081828-bedf-5df8-bf37-2468e76b29a4 with scrape type 2
2026-03-30 05:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f081828-bedf-5df8-bf37-2468e76b29a4, identifier: KE72170
2026-03-30 05:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f081828-bedf-5df8-bf37-2468e76b29a4 with identifier: KE72170
2026-03-30 05:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f081828-bedf-5df8-bf37-2468e76b29a4 with identifier: KE72170
2026-03-30 05:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f081828-bedf-5df8-bf37-2468e76b29a4 with identifier: KE72170 to the API
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'diesel',
 'id': '6f081828-bedf-5df8-bf37-2468e76b29a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE72170',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 291598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Saving data for KE72170: {'auction_closing_time': 1774885911.0, 'created_time': 1773917386.140706, 'last_price_update_time': 1774848782.388953}
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE72170') HTTP/1.1" 204 0
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-30 05:33:02 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Scrape type for YY45695: 2
2026-03-30 05:33:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cb90f9-ae25-5c13-abfb-abb2fb92285a with identifier: YY45695
2026-03-30 05:33:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cb90f9-ae25-5c13-abfb-abb2fb92285a with scrape type 2
2026-03-30 05:33:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8cb90f9-ae25-5c13-abfb-abb2fb92285a with scrape type 2
2026-03-30 05:33:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8cb90f9-ae25-5c13-abfb-abb2fb92285a, identifier: YY45695
2026-03-30 05:33:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8cb90f9-ae25-5c13-abfb-abb2fb92285a with identifier: YY45695
2026-03-30 05:33:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8cb90f9-ae25-5c13-abfb-abb2fb92285a with identifier: YY45695
2026-03-30 05:33:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8cb90f9-ae25-5c13-abfb-abb2fb92285a with identifier: YY45695 to the API
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:54Z',
 'fuel_type': 'petrol',
 'id': 'c8cb90f9-ae25-5c13-abfb-abb2fb92285a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY45695',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 68999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-30 05:33:02 [auto1.de] INFO: Saving data for YY45695: {'auction_closing_time': 1774883574.0, 'created_time': 1772729174.105557, 'last_price_update_time': 1774848782.946149}
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY45695') HTTP/1.1" 204 0
2026-03-30 05:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:03 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-30 05:33:03 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-30 05:33:03 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-30 05:33:03 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-30 05:33:03 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-30 05:33:03 [auto1.de] INFO: Scrape type for EB91533: 2
2026-03-30 05:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105e7132-0ee7-50be-b56b-87b161537260 with identifier: EB91533
2026-03-30 05:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105e7132-0ee7-50be-b56b-87b161537260 with scrape type 2
2026-03-30 05:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 105e7132-0ee7-50be-b56b-87b161537260 with scrape type 2
2026-03-30 05:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 105e7132-0ee7-50be-b56b-87b161537260, identifier: EB91533
2026-03-30 05:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 105e7132-0ee7-50be-b56b-87b161537260 with identifier: EB91533
2026-03-30 05:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 105e7132-0ee7-50be-b56b-87b161537260 with identifier: EB91533
2026-03-30 05:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 105e7132-0ee7-50be-b56b-87b161537260 with identifier: EB91533 to the API
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:57:57Z',
 'fuel_type': 'diesel',
 'id': '105e7132-0ee7-50be-b56b-87b161537260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB91533',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 240970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi TD Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-30 05:33:04 [auto1.de] INFO: Saving data for EB91533: {'auction_closing_time': 1774886277.0, 'created_time': 1774638549.836562, 'last_price_update_time': 1774848784.316258}
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB91533') HTTP/1.1" 204 0
2026-03-30 05:33:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:04 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 05:33:04 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-30 05:33:04 [auto1.de] INFO: Scrape type for UH43382: 2
2026-03-30 05:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25db7022-d1a9-5d61-8a35-407c02332651 with identifier: UH43382
2026-03-30 05:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25db7022-d1a9-5d61-8a35-407c02332651 with scrape type 2
2026-03-30 05:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25db7022-d1a9-5d61-8a35-407c02332651 with scrape type 2
2026-03-30 05:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25db7022-d1a9-5d61-8a35-407c02332651, identifier: UH43382
2026-03-30 05:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25db7022-d1a9-5d61-8a35-407c02332651 with identifier: UH43382
2026-03-30 05:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25db7022-d1a9-5d61-8a35-407c02332651 with identifier: UH43382
2026-03-30 05:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25db7022-d1a9-5d61-8a35-407c02332651 with identifier: UH43382 to the API
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-30T15:46:13Z',
 'fuel_type': 'petrol',
 'id': '25db7022-d1a9-5d61-8a35-407c02332651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH43382',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 209517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo Innovation 4x4',
 'transmission': 'automatic',
 'trim': 'Innovation 4x4',
 'year': 2012}
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-30 05:33:04 [auto1.de] INFO: Saving data for UH43382: {'auction_closing_time': 1774885573.0, 'created_time': 1773306863.468788, 'last_price_update_time': 1774848784.742237}
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH43382') HTTP/1.1" 204 0
2026-03-30 05:33:04 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 05:33:04 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-30 05:33:04 [auto1.de] INFO: Scrape type for WN92632: 0
2026-03-30 05:33:04 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-30 05:33:04 [auto1.de] INFO: Scrape type for NW86422: 2
2026-03-30 05:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873e6c09-c8ae-500d-b125-9563552a5765 with identifier: NW86422
2026-03-30 05:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873e6c09-c8ae-500d-b125-9563552a5765 with scrape type 2
2026-03-30 05:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873e6c09-c8ae-500d-b125-9563552a5765 with scrape type 2
2026-03-30 05:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 873e6c09-c8ae-500d-b125-9563552a5765, identifier: NW86422
2026-03-30 05:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 873e6c09-c8ae-500d-b125-9563552a5765 with identifier: NW86422
2026-03-30 05:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 873e6c09-c8ae-500d-b125-9563552a5765 with identifier: NW86422
2026-03-30 05:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 873e6c09-c8ae-500d-b125-9563552a5765 with identifier: NW86422 to the API
2026-03-30 05:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'diesel',
 'id': '873e6c09-c8ae-500d-b125-9563552a5765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW86422',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 253828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-20',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Saving data for NW86422: {'auction_closing_time': 1774882992.0, 'created_time': 1774349614.787852, 'last_price_update_time': 1774848785.163773}
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW86422') HTTP/1.1" 204 0
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Scrape type for BY26961: 2
2026-03-30 05:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c74769f-b05c-531d-8657-60aa184209ba with identifier: BY26961
2026-03-30 05:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c74769f-b05c-531d-8657-60aa184209ba with scrape type 2
2026-03-30 05:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c74769f-b05c-531d-8657-60aa184209ba with scrape type 2
2026-03-30 05:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c74769f-b05c-531d-8657-60aa184209ba, identifier: BY26961
2026-03-30 05:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c74769f-b05c-531d-8657-60aa184209ba with identifier: BY26961
2026-03-30 05:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c74769f-b05c-531d-8657-60aa184209ba with identifier: BY26961
2026-03-30 05:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c74769f-b05c-531d-8657-60aa184209ba with identifier: BY26961 to the API
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:19:40Z',
 'fuel_type': 'petrol',
 'id': '8c74769f-b05c-531d-8657-60aa184209ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY26961',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 73777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Saving data for BY26961: {'auction_closing_time': 1774883980.0, 'created_time': 1774637285.765435, 'last_price_update_time': 1774848785.697105}
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY26961') HTTP/1.1" 204 0
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-30 05:33:05 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-30 05:33:05 [auto1.de] INFO: Scrape type for RR77511: 2
2026-03-30 05:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f53911a-4aa4-5c2f-8268-db78ad3949ca with identifier: RR77511
2026-03-30 05:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f53911a-4aa4-5c2f-8268-db78ad3949ca with scrape type 2
2026-03-30 05:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f53911a-4aa4-5c2f-8268-db78ad3949ca with scrape type 2
2026-03-30 05:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f53911a-4aa4-5c2f-8268-db78ad3949ca, identifier: RR77511
2026-03-30 05:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f53911a-4aa4-5c2f-8268-db78ad3949ca with identifier: RR77511
2026-03-30 05:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f53911a-4aa4-5c2f-8268-db78ad3949ca with identifier: RR77511
2026-03-30 05:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f53911a-4aa4-5c2f-8268-db78ad3949ca with identifier: RR77511 to the API
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:51:41Z',
 'fuel_type': 'hybrid',
 'id': '4f53911a-4aa4-5c2f-8268-db78ad3949ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR77511',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius+',
 'odometer': 158494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Toyota Prius+ 1.8 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Saving data for RR77511: {'auction_closing_time': 1774885901.0, 'created_time': 1774637134.89211, 'last_price_update_time': 1774848786.102274}
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR77511') HTTP/1.1" 204 0
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Scrape type for FD81187: 0
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Scrape type for HW87137: 2
2026-03-30 05:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 380868d8-0a2e-5e70-be71-ba6ab4886a2b with identifier: HW87137
2026-03-30 05:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380868d8-0a2e-5e70-be71-ba6ab4886a2b with scrape type 2
2026-03-30 05:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 380868d8-0a2e-5e70-be71-ba6ab4886a2b with scrape type 2
2026-03-30 05:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 380868d8-0a2e-5e70-be71-ba6ab4886a2b, identifier: HW87137
2026-03-30 05:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 380868d8-0a2e-5e70-be71-ba6ab4886a2b with identifier: HW87137
2026-03-30 05:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 380868d8-0a2e-5e70-be71-ba6ab4886a2b with identifier: HW87137
2026-03-30 05:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 380868d8-0a2e-5e70-be71-ba6ab4886a2b with identifier: HW87137 to the API
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:08:43Z',
 'fuel_type': 'diesel',
 'id': '380868d8-0a2e-5e70-be71-ba6ab4886a2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW87137',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 132010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-25',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2022}
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Saving data for HW87137: {'auction_closing_time': 1774883323.0, 'created_time': 1773428995.603982, 'last_price_update_time': 1774848786.516053}
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW87137') HTTP/1.1" 204 0
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-30 05:33:06 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-30 05:33:06 [auto1.de] INFO: Scrape type for MT08770: 2
2026-03-30 05:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0efd81a-b72b-56aa-ac7a-c310a799abfe with identifier: MT08770
2026-03-30 05:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0efd81a-b72b-56aa-ac7a-c310a799abfe with scrape type 2
2026-03-30 05:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0efd81a-b72b-56aa-ac7a-c310a799abfe with scrape type 2
2026-03-30 05:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0efd81a-b72b-56aa-ac7a-c310a799abfe, identifier: MT08770
2026-03-30 05:33:06 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 11 pages/min), scraped 139 items (at 87 items/min)
2026-03-30 05:33:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0efd81a-b72b-56aa-ac7a-c310a799abfe with identifier: MT08770
2026-03-30 05:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0efd81a-b72b-56aa-ac7a-c310a799abfe with identifier: MT08770
2026-03-30 05:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0efd81a-b72b-56aa-ac7a-c310a799abfe with identifier: MT08770 to the API
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:52:54Z',
 'fuel_type': 'petrol',
 'id': 'f0efd81a-b72b-56aa-ac7a-c310a799abfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT08770',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 137679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-16',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2009}
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Saving data for MT08770: {'auction_closing_time': 1774885974.0, 'created_time': 1774549861.680513, 'last_price_update_time': 1774848787.020677}
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT08770') HTTP/1.1" 204 0
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Scrape type for CD09262: 2
2026-03-30 05:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34040268-0acf-5aa2-b64b-66f5c8f463e6 with identifier: CD09262
2026-03-30 05:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34040268-0acf-5aa2-b64b-66f5c8f463e6 with scrape type 2
2026-03-30 05:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34040268-0acf-5aa2-b64b-66f5c8f463e6 with scrape type 2
2026-03-30 05:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34040268-0acf-5aa2-b64b-66f5c8f463e6, identifier: CD09262
2026-03-30 05:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34040268-0acf-5aa2-b64b-66f5c8f463e6 with identifier: CD09262
2026-03-30 05:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34040268-0acf-5aa2-b64b-66f5c8f463e6 with identifier: CD09262
2026-03-30 05:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34040268-0acf-5aa2-b64b-66f5c8f463e6 with identifier: CD09262 to the API
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:10Z',
 'fuel_type': 'petrol',
 'id': '34040268-0acf-5aa2-b64b-66f5c8f463e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD09262',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 78218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Pure Black',
 'transmission': 'manual',
 'trim': 'Pure Black',
 'year': 2012}
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Saving data for CD09262: {'auction_closing_time': 1774884910.0, 'created_time': 1774034301.809504, 'last_price_update_time': 1774848787.573591}
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD09262') HTTP/1.1" 204 0
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-30 05:33:07 [auto1.de] INFO: Scrape type for SG95649: 0
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-30 05:33:07 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 05:33:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:37 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-30 05:33:37 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-30 05:33:37 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-30 05:33:37 [auto1.de] INFO: Scrape type for DT85879: 2
2026-03-30 05:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77915614-4472-5b6d-9d6f-111044745411 with identifier: DT85879
2026-03-30 05:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77915614-4472-5b6d-9d6f-111044745411 with scrape type 2
2026-03-30 05:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77915614-4472-5b6d-9d6f-111044745411 with scrape type 2
2026-03-30 05:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77915614-4472-5b6d-9d6f-111044745411, identifier: DT85879
2026-03-30 05:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77915614-4472-5b6d-9d6f-111044745411 with identifier: DT85879
2026-03-30 05:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77915614-4472-5b6d-9d6f-111044745411 with identifier: DT85879
2026-03-30 05:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77915614-4472-5b6d-9d6f-111044745411 with identifier: DT85879 to the API
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:11:12Z',
 'fuel_type': 'petrol',
 'id': '77915614-4472-5b6d-9d6f-111044745411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT85879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 125742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-14',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2016}
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-30 05:33:37 [auto1.de] INFO: Saving data for DT85879: {'auction_closing_time': 1774883472.0, 'created_time': 1774002094.186118, 'last_price_update_time': 1774848817.981682}
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT85879') HTTP/1.1" 204 0
2026-03-30 05:33:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:38 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-30 05:33:38 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-30 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-30 05:33:38 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-30 05:33:38 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-30 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-30 05:33:38 [auto1.de] INFO: Scrape type for JS20731: 2
2026-03-30 05:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e333cf8-b0e5-5417-b0a4-358a4951fcab with identifier: JS20731
2026-03-30 05:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e333cf8-b0e5-5417-b0a4-358a4951fcab with scrape type 2
2026-03-30 05:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e333cf8-b0e5-5417-b0a4-358a4951fcab with scrape type 2
2026-03-30 05:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e333cf8-b0e5-5417-b0a4-358a4951fcab, identifier: JS20731
2026-03-30 05:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e333cf8-b0e5-5417-b0a4-358a4951fcab with identifier: JS20731
2026-03-30 05:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e333cf8-b0e5-5417-b0a4-358a4951fcab with identifier: JS20731
2026-03-30 05:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e333cf8-b0e5-5417-b0a4-358a4951fcab with identifier: JS20731 to the API
2026-03-30 05:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': '7e333cf8-b0e5-5417-b0a4-358a4951fcab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS20731',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 48228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2020}
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Saving data for JS20731: {'auction_closing_time': 1774885284.0, 'created_time': 1774638997.59415, 'last_price_update_time': 1774848819.464954}
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS20731') HTTP/1.1" 204 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-30 05:33:39 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Scrape type for JP57699: 2
2026-03-30 05:33:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013d675a-4df5-5f06-9b12-8e04dde87b1e with identifier: JP57699
2026-03-30 05:33:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013d675a-4df5-5f06-9b12-8e04dde87b1e with scrape type 2
2026-03-30 05:33:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013d675a-4df5-5f06-9b12-8e04dde87b1e with scrape type 2
2026-03-30 05:33:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013d675a-4df5-5f06-9b12-8e04dde87b1e, identifier: JP57699
2026-03-30 05:33:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013d675a-4df5-5f06-9b12-8e04dde87b1e with identifier: JP57699
2026-03-30 05:33:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013d675a-4df5-5f06-9b12-8e04dde87b1e with identifier: JP57699
2026-03-30 05:33:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013d675a-4df5-5f06-9b12-8e04dde87b1e with identifier: JP57699 to the API
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:07Z',
 'fuel_type': 'petrol',
 'id': '013d675a-4df5-5f06-9b12-8e04dde87b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP57699',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 75211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2019}
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-30 05:33:39 [auto1.de] INFO: Saving data for JP57699: {'auction_closing_time': 1774885387.0, 'created_time': 1774637037.754451, 'last_price_update_time': 1774848819.979849}
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP57699') HTTP/1.1" 204 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Scrape type for TE89273: 2
2026-03-30 05:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f78595da-a066-538b-8d39-d1118624d71a with identifier: TE89273
2026-03-30 05:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f78595da-a066-538b-8d39-d1118624d71a with scrape type 2
2026-03-30 05:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f78595da-a066-538b-8d39-d1118624d71a with scrape type 2
2026-03-30 05:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f78595da-a066-538b-8d39-d1118624d71a, identifier: TE89273
2026-03-30 05:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f78595da-a066-538b-8d39-d1118624d71a with identifier: TE89273
2026-03-30 05:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f78595da-a066-538b-8d39-d1118624d71a with identifier: TE89273
2026-03-30 05:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f78595da-a066-538b-8d39-d1118624d71a with identifier: TE89273 to the API
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:16:13Z',
 'fuel_type': 'petrol',
 'id': 'f78595da-a066-538b-8d39-d1118624d71a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE89273',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 208268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Saving data for TE89273: {'auction_closing_time': 1774883773.0, 'created_time': 1774637282.689933, 'last_price_update_time': 1774848820.511665}
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE89273') HTTP/1.1" 204 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Scrape type for ZT71502: 2
2026-03-30 05:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 861d5f65-d06b-59a0-b4d3-d40109ce9600 with identifier: ZT71502
2026-03-30 05:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 861d5f65-d06b-59a0-b4d3-d40109ce9600 with scrape type 2
2026-03-30 05:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 861d5f65-d06b-59a0-b4d3-d40109ce9600 with scrape type 2
2026-03-30 05:33:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 861d5f65-d06b-59a0-b4d3-d40109ce9600, identifier: ZT71502
2026-03-30 05:33:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 861d5f65-d06b-59a0-b4d3-d40109ce9600 with identifier: ZT71502
2026-03-30 05:33:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 861d5f65-d06b-59a0-b4d3-d40109ce9600 with identifier: ZT71502
2026-03-30 05:33:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 861d5f65-d06b-59a0-b4d3-d40109ce9600 with identifier: ZT71502 to the API
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:11:09Z',
 'fuel_type': 'diesel',
 'id': '861d5f65-d06b-59a0-b4d3-d40109ce9600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT71502',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 209620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-07',
 'seller_name': None,
 'title': 'Land Rover Range Rover 4.4 TD V8 Vogue',
 'transmission': 'automatic',
 'trim': 'Vogue',
 'year': 2012}
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Saving data for ZT71502: {'auction_closing_time': 1774883469.0, 'created_time': 1772547128.311834, 'last_price_update_time': 1774848820.94909}
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT71502') HTTP/1.1" 204 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-30 05:33:40 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 05:33:40 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 05:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-30 05:33:41 [auto1.de] INFO: Scrape type for HB66964: 2
2026-03-30 05:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc76384b-7524-5241-bffe-94c9782ced47 with identifier: HB66964
2026-03-30 05:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc76384b-7524-5241-bffe-94c9782ced47 with scrape type 2
2026-03-30 05:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc76384b-7524-5241-bffe-94c9782ced47 with scrape type 2
2026-03-30 05:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc76384b-7524-5241-bffe-94c9782ced47, identifier: HB66964
2026-03-30 05:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc76384b-7524-5241-bffe-94c9782ced47 with identifier: HB66964
2026-03-30 05:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc76384b-7524-5241-bffe-94c9782ced47 with identifier: HB66964
2026-03-30 05:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc76384b-7524-5241-bffe-94c9782ced47 with identifier: HB66964 to the API
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'diesel',
 'id': 'cc76384b-7524-5241-bffe-94c9782ced47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB66964',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 119417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-30 05:33:41 [auto1.de] INFO: Saving data for HB66964: {'auction_closing_time': 1774884213.0, 'created_time': 1774550451.52741, 'last_price_update_time': 1774848821.389816}
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB66964') HTTP/1.1" 204 0
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-30 05:33:41 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 05:33:41 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-30 05:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:42 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:42 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-30 05:33:42 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-30 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-30 05:33:42 [auto1.de] INFO: Scrape type for RC68587: 2
2026-03-30 05:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b3b95f-70c3-5746-aa5f-5ec846e06439 with identifier: RC68587
2026-03-30 05:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b3b95f-70c3-5746-aa5f-5ec846e06439 with scrape type 2
2026-03-30 05:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b3b95f-70c3-5746-aa5f-5ec846e06439 with scrape type 2
2026-03-30 05:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70b3b95f-70c3-5746-aa5f-5ec846e06439, identifier: RC68587
2026-03-30 05:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70b3b95f-70c3-5746-aa5f-5ec846e06439 with identifier: RC68587
2026-03-30 05:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70b3b95f-70c3-5746-aa5f-5ec846e06439 with identifier: RC68587
2026-03-30 05:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70b3b95f-70c3-5746-aa5f-5ec846e06439 with identifier: RC68587 to the API
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:19Z',
 'fuel_type': 'petrol',
 'id': '70b3b95f-70c3-5746-aa5f-5ec846e06439',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC68587',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 31366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Saving data for RC68587: {'auction_closing_time': 1774884979.0, 'created_time': 1774636975.153514, 'last_price_update_time': 1774848823.246368}
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC68587') HTTP/1.1" 204 0
2026-03-30 05:33:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for NX86319: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for KY27003: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for TU42295: 2
2026-03-30 05:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c7be853-c725-531f-afa0-85ca06032af4 with identifier: TU42295
2026-03-30 05:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c7be853-c725-531f-afa0-85ca06032af4 with scrape type 2
2026-03-30 05:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c7be853-c725-531f-afa0-85ca06032af4 with scrape type 2
2026-03-30 05:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c7be853-c725-531f-afa0-85ca06032af4, identifier: TU42295
2026-03-30 05:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c7be853-c725-531f-afa0-85ca06032af4 with identifier: TU42295
2026-03-30 05:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c7be853-c725-531f-afa0-85ca06032af4 with identifier: TU42295
2026-03-30 05:33:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c7be853-c725-531f-afa0-85ca06032af4 with identifier: TU42295 to the API
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:36:43Z',
 'fuel_type': 'petrol',
 'id': '1c7be853-c725-531f-afa0-85ca06032af4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU42295',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 170044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-30',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2015}
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Saving data for TU42295: {'auction_closing_time': 1774885003.0, 'created_time': 1773428180.198829, 'last_price_update_time': 1774848823.697725}
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU42295') HTTP/1.1" 204 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-30 05:33:43 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-30 05:33:43 [auto1.de] INFO: Scrape type for ZX84007: 2
2026-03-30 05:33:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10b0a85-e36a-589e-adfd-6423ab29d30e with identifier: ZX84007
2026-03-30 05:33:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10b0a85-e36a-589e-adfd-6423ab29d30e with scrape type 2
2026-03-30 05:33:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10b0a85-e36a-589e-adfd-6423ab29d30e with scrape type 2
2026-03-30 05:33:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d10b0a85-e36a-589e-adfd-6423ab29d30e, identifier: ZX84007
2026-03-30 05:33:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d10b0a85-e36a-589e-adfd-6423ab29d30e with identifier: ZX84007
2026-03-30 05:33:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d10b0a85-e36a-589e-adfd-6423ab29d30e with identifier: ZX84007
2026-03-30 05:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d10b0a85-e36a-589e-adfd-6423ab29d30e with identifier: ZX84007 to the API
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:47Z',
 'fuel_type': 'diesel',
 'id': 'd10b0a85-e36a-589e-adfd-6423ab29d30e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX84007',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 203641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Saving data for ZX84007: {'auction_closing_time': 1774882967.0, 'created_time': 1773344487.686224, 'last_price_update_time': 1774848824.280147}
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX84007') HTTP/1.1" 204 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for FV50908: 2
2026-03-30 05:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 940888dd-7201-52a8-9ad0-992918ae5652 with identifier: FV50908
2026-03-30 05:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 940888dd-7201-52a8-9ad0-992918ae5652 with scrape type 2
2026-03-30 05:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 940888dd-7201-52a8-9ad0-992918ae5652 with scrape type 2
2026-03-30 05:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 940888dd-7201-52a8-9ad0-992918ae5652, identifier: FV50908
2026-03-30 05:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 940888dd-7201-52a8-9ad0-992918ae5652 with identifier: FV50908
2026-03-30 05:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 940888dd-7201-52a8-9ad0-992918ae5652 with identifier: FV50908
2026-03-30 05:33:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 940888dd-7201-52a8-9ad0-992918ae5652 with identifier: FV50908 to the API
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 612,
 'expiration_date': '2026-03-30T15:07:13Z',
 'fuel_type': 'petrol',
 'id': '940888dd-7201-52a8-9ad0-992918ae5652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV50908',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 115830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 63 AMG L 4Matic',
 'transmission': 'automatic',
 'trim': 'L 4Matic',
 'year': 2018}
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Saving data for FV50908: {'auction_closing_time': 1774883233.0, 'created_time': 1773917333.733782, 'last_price_update_time': 1774848824.681847}
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV50908') HTTP/1.1" 204 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for SC87676: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for RN81514: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for FY99153: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-30 05:33:44 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-30 05:33:44 [auto1.de] INFO: Scrape type for MM43491: 2
2026-03-30 05:33:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-30 05:33:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f935c431-cf02-51e5-9b07-76168393dbfd with scrape type 2
2026-03-30 05:33:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f935c431-cf02-51e5-9b07-76168393dbfd with scrape type 2
2026-03-30 05:33:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f935c431-cf02-51e5-9b07-76168393dbfd, identifier: MM43491
2026-03-30 05:33:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-30 05:33:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491
2026-03-30 05:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f935c431-cf02-51e5-9b07-76168393dbfd with identifier: MM43491 to the API
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:24:42Z',
 'fuel_type': 'petrol',
 'id': 'f935c431-cf02-51e5-9b07-76168393dbfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM43491',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 48058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-22',
 'seller_name': None,
 'title': 'Ford Puma 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2022}
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-30 05:33:45 [auto1.de] INFO: Saving data for MM43491: {'auction_closing_time': 1774884282.0, 'created_time': 1774675843.362134, 'last_price_update_time': 1774848825.237008}
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM43491') HTTP/1.1" 204 0
2026-03-30 05:33:45 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-30 05:33:45 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-30 05:33:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:46 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-30 05:33:46 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-30 05:33:46 [auto1.de] INFO: Scrape type for VJ41763: 2
2026-03-30 05:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d80561f-d95e-570c-8b31-5a691b78d96c with identifier: VJ41763
2026-03-30 05:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d80561f-d95e-570c-8b31-5a691b78d96c with scrape type 2
2026-03-30 05:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d80561f-d95e-570c-8b31-5a691b78d96c with scrape type 2
2026-03-30 05:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d80561f-d95e-570c-8b31-5a691b78d96c, identifier: VJ41763
2026-03-30 05:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d80561f-d95e-570c-8b31-5a691b78d96c with identifier: VJ41763
2026-03-30 05:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d80561f-d95e-570c-8b31-5a691b78d96c with identifier: VJ41763
2026-03-30 05:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d80561f-d95e-570c-8b31-5a691b78d96c with identifier: VJ41763 to the API
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:38:39Z',
 'fuel_type': 'petrol',
 'id': '5d80561f-d95e-570c-8b31-5a691b78d96c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ41763',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 153920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-21',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI R',
 'transmission': 'manual',
 'trim': 'R',
 'year': 2011}
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-30 05:33:46 [auto1.de] INFO: Saving data for VJ41763: {'auction_closing_time': 1774885119.0, 'created_time': 1773945935.719204, 'last_price_update_time': 1774848826.693699}
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ41763') HTTP/1.1" 204 0
2026-03-30 05:33:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:46 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-30 05:33:46 [auto1.de] INFO: Scrape type for BN05463: 2
2026-03-30 05:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236f5fb3-bb8b-5682-9acf-b2163791c59c with identifier: BN05463
2026-03-30 05:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236f5fb3-bb8b-5682-9acf-b2163791c59c with scrape type 2
2026-03-30 05:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 236f5fb3-bb8b-5682-9acf-b2163791c59c with scrape type 2
2026-03-30 05:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 236f5fb3-bb8b-5682-9acf-b2163791c59c, identifier: BN05463
2026-03-30 05:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 236f5fb3-bb8b-5682-9acf-b2163791c59c with identifier: BN05463
2026-03-30 05:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 236f5fb3-bb8b-5682-9acf-b2163791c59c with identifier: BN05463
2026-03-30 05:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 236f5fb3-bb8b-5682-9acf-b2163791c59c with identifier: BN05463 to the API
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:04Z',
 'fuel_type': 'petrol',
 'id': '236f5fb3-bb8b-5682-9acf-b2163791c59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN05463',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-23',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-30 05:33:47 [auto1.de] INFO: Saving data for BN05463: {'auction_closing_time': 1774885504.0, 'created_time': 1774638621.041161, 'last_price_update_time': 1774848827.100502}
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN05463') HTTP/1.1" 204 0
2026-03-30 05:33:47 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-30 05:33:47 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-30 05:33:47 [auto1.de] INFO: Scrape type for LY63644: 0
2026-03-30 05:33:47 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-30 05:33:47 [auto1.de] INFO: Scrape type for KE01132: 2
2026-03-30 05:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc7e84a7-dd60-5612-ab58-614ad6ccea42 with identifier: KE01132
2026-03-30 05:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc7e84a7-dd60-5612-ab58-614ad6ccea42 with scrape type 2
2026-03-30 05:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc7e84a7-dd60-5612-ab58-614ad6ccea42 with scrape type 2
2026-03-30 05:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc7e84a7-dd60-5612-ab58-614ad6ccea42, identifier: KE01132
2026-03-30 05:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc7e84a7-dd60-5612-ab58-614ad6ccea42 with identifier: KE01132
2026-03-30 05:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc7e84a7-dd60-5612-ab58-614ad6ccea42 with identifier: KE01132
2026-03-30 05:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc7e84a7-dd60-5612-ab58-614ad6ccea42 with identifier: KE01132 to the API
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'diesel',
 'id': 'fc7e84a7-dd60-5612-ab58-614ad6ccea42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE01132',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 133584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-30 05:33:47 [auto1.de] INFO: Saving data for KE01132: {'auction_closing_time': 1774886285.0, 'created_time': 1774550634.168135, 'last_price_update_time': 1774848827.533598}
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE01132') HTTP/1.1" 204 0
2026-03-30 05:33:47 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-30 05:33:47 [auto1.de] INFO: Scrape type for KU33020: 2
2026-03-30 05:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f13a1db9-67f9-51a7-9694-5c002f2c2dba with identifier: KU33020
2026-03-30 05:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f13a1db9-67f9-51a7-9694-5c002f2c2dba with scrape type 2
2026-03-30 05:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f13a1db9-67f9-51a7-9694-5c002f2c2dba with scrape type 2
2026-03-30 05:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f13a1db9-67f9-51a7-9694-5c002f2c2dba, identifier: KU33020
2026-03-30 05:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f13a1db9-67f9-51a7-9694-5c002f2c2dba with identifier: KU33020
2026-03-30 05:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f13a1db9-67f9-51a7-9694-5c002f2c2dba with identifier: KU33020
2026-03-30 05:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f13a1db9-67f9-51a7-9694-5c002f2c2dba with identifier: KU33020 to the API
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:49:31Z',
 'fuel_type': 'diesel',
 'id': 'f13a1db9-67f9-51a7-9694-5c002f2c2dba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU33020',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 39400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2023}
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Saving data for KU33020: {'auction_closing_time': 1774885771.0, 'created_time': 1773302879.100166, 'last_price_update_time': 1774848828.041506}
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU33020') HTTP/1.1" 204 0
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Scrape type for UE61705: 0
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Scrape type for LH20515: 2
2026-03-30 05:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 840ea65b-1562-594f-abe7-0c74ea89567e with identifier: LH20515
2026-03-30 05:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 840ea65b-1562-594f-abe7-0c74ea89567e with scrape type 2
2026-03-30 05:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 840ea65b-1562-594f-abe7-0c74ea89567e with scrape type 2
2026-03-30 05:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 840ea65b-1562-594f-abe7-0c74ea89567e, identifier: LH20515
2026-03-30 05:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 840ea65b-1562-594f-abe7-0c74ea89567e with identifier: LH20515
2026-03-30 05:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 840ea65b-1562-594f-abe7-0c74ea89567e with identifier: LH20515
2026-03-30 05:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 840ea65b-1562-594f-abe7-0c74ea89567e with identifier: LH20515 to the API
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'petrol',
 'id': '840ea65b-1562-594f-abe7-0c74ea89567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH20515',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 138701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'BMW 6er 640i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Saving data for LH20515: {'auction_closing_time': 1774884198.0, 'created_time': 1774349952.697478, 'last_price_update_time': 1774848828.588962}
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH20515') HTTP/1.1" 204 0
2026-03-30 05:33:48 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-30 05:33:48 [auto1.de] INFO: Scrape type for ED89448: 2
2026-03-30 05:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3adc40b2-f9a6-5055-a760-6448142c4e12 with identifier: ED89448
2026-03-30 05:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3adc40b2-f9a6-5055-a760-6448142c4e12 with scrape type 2
2026-03-30 05:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3adc40b2-f9a6-5055-a760-6448142c4e12 with scrape type 2
2026-03-30 05:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3adc40b2-f9a6-5055-a760-6448142c4e12, identifier: ED89448
2026-03-30 05:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3adc40b2-f9a6-5055-a760-6448142c4e12 with identifier: ED89448
2026-03-30 05:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3adc40b2-f9a6-5055-a760-6448142c4e12 with identifier: ED89448
2026-03-30 05:33:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3adc40b2-f9a6-5055-a760-6448142c4e12 with identifier: ED89448 to the API
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-30T15:37:48Z',
 'fuel_type': 'diesel',
 'id': '3adc40b2-f9a6-5055-a760-6448142c4e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED89448',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 90436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-07',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Business Elegance',
 'transmission': 'automatic',
 'trim': 'Business Elegance',
 'year': 2021}
2026-03-30 05:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Saving data for ED89448: {'auction_closing_time': 1774885068.0, 'created_time': 1774549887.810209, 'last_price_update_time': 1774848829.003243}
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED89448') HTTP/1.1" 204 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for JE00015: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: US49854
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for ZB74366: 2
2026-03-30 05:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-30 05:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ce627d-c6e8-5c78-92b6-29624c1ca007 with scrape type 2
2026-03-30 05:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49ce627d-c6e8-5c78-92b6-29624c1ca007 with scrape type 2
2026-03-30 05:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49ce627d-c6e8-5c78-92b6-29624c1ca007, identifier: ZB74366
2026-03-30 05:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-30 05:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366
2026-03-30 05:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49ce627d-c6e8-5c78-92b6-29624c1ca007 with identifier: ZB74366 to the API
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:07Z',
 'fuel_type': 'diesel',
 'id': '49ce627d-c6e8-5c78-92b6-29624c1ca007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB74366',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 332391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Saving data for ZB74366: {'auction_closing_time': 1774884367.0, 'created_time': 1774552712.769136, 'last_price_update_time': 1774848829.597458}
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB74366') HTTP/1.1" 204 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-30 05:33:49 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-30 05:33:49 [auto1.de] INFO: Scrape type for GY11970: 2
2026-03-30 05:33:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c88f88-dcb7-5375-b0d9-442ac5388c49 with identifier: GY11970
2026-03-30 05:33:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c88f88-dcb7-5375-b0d9-442ac5388c49 with scrape type 2
2026-03-30 05:33:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c88f88-dcb7-5375-b0d9-442ac5388c49 with scrape type 2
2026-03-30 05:33:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8c88f88-dcb7-5375-b0d9-442ac5388c49, identifier: GY11970
2026-03-30 05:33:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8c88f88-dcb7-5375-b0d9-442ac5388c49 with identifier: GY11970
2026-03-30 05:33:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8c88f88-dcb7-5375-b0d9-442ac5388c49 with identifier: GY11970
2026-03-30 05:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8c88f88-dcb7-5375-b0d9-442ac5388c49 with identifier: GY11970 to the API
2026-03-30 05:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:00:25Z',
 'fuel_type': 'petrol',
 'id': 'f8c88f88-dcb7-5375-b0d9-442ac5388c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY11970',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 81242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2016}
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-30 05:33:50 [auto1.de] INFO: Saving data for GY11970: {'auction_closing_time': 1774882825.0, 'created_time': 1773946427.707037, 'last_price_update_time': 1774848830.136983}
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY11970') HTTP/1.1" 204 0
2026-03-30 05:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:50 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:50 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-30 05:33:50 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-30 05:33:50 [auto1.de] INFO: Scrape type for KF39713: 2
2026-03-30 05:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4aea7f3-8a60-5568-b4c6-979dd156310d with identifier: KF39713
2026-03-30 05:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4aea7f3-8a60-5568-b4c6-979dd156310d with scrape type 2
2026-03-30 05:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4aea7f3-8a60-5568-b4c6-979dd156310d with scrape type 2
2026-03-30 05:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4aea7f3-8a60-5568-b4c6-979dd156310d, identifier: KF39713
2026-03-30 05:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4aea7f3-8a60-5568-b4c6-979dd156310d with identifier: KF39713
2026-03-30 05:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4aea7f3-8a60-5568-b4c6-979dd156310d with identifier: KF39713
2026-03-30 05:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4aea7f3-8a60-5568-b4c6-979dd156310d with identifier: KF39713 to the API
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:09:52Z',
 'fuel_type': 'diesel',
 'id': 'e4aea7f3-8a60-5568-b4c6-979dd156310d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF39713',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 30509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-30 05:33:50 [auto1.de] INFO: Saving data for KF39713: {'auction_closing_time': 1774883392.0, 'created_time': 1773135044.884882, 'last_price_update_time': 1774848830.657174}
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF39713') HTTP/1.1" 204 0
2026-03-30 05:33:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:50 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-30 05:33:50 [auto1.de] INFO: Scrape type for BD66077: 2
2026-03-30 05:33:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af9649e6-b7fd-54dd-91e2-541986755e8d with identifier: BD66077
2026-03-30 05:33:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af9649e6-b7fd-54dd-91e2-541986755e8d with scrape type 2
2026-03-30 05:33:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af9649e6-b7fd-54dd-91e2-541986755e8d with scrape type 2
2026-03-30 05:33:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af9649e6-b7fd-54dd-91e2-541986755e8d, identifier: BD66077
2026-03-30 05:33:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af9649e6-b7fd-54dd-91e2-541986755e8d with identifier: BD66077
2026-03-30 05:33:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af9649e6-b7fd-54dd-91e2-541986755e8d with identifier: BD66077
2026-03-30 05:33:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af9649e6-b7fd-54dd-91e2-541986755e8d with identifier: BD66077 to the API
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': 'af9649e6-b7fd-54dd-91e2-541986755e8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD66077',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 186043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2016}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Saving data for BD66077: {'auction_closing_time': 1774884877.0, 'created_time': 1774549837.193822, 'last_price_update_time': 1774848831.065395}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD66077') HTTP/1.1" 204 0
2026-03-30 05:33:51 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-30 05:33:51 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Scrape type for AG64287: 2
2026-03-30 05:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9227784e-aa23-59cb-821b-d6d998ddccea with identifier: AG64287
2026-03-30 05:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9227784e-aa23-59cb-821b-d6d998ddccea with scrape type 2
2026-03-30 05:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9227784e-aa23-59cb-821b-d6d998ddccea with scrape type 2
2026-03-30 05:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9227784e-aa23-59cb-821b-d6d998ddccea, identifier: AG64287
2026-03-30 05:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9227784e-aa23-59cb-821b-d6d998ddccea with identifier: AG64287
2026-03-30 05:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9227784e-aa23-59cb-821b-d6d998ddccea with identifier: AG64287
2026-03-30 05:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9227784e-aa23-59cb-821b-d6d998ddccea with identifier: AG64287 to the API
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'diesel',
 'id': '9227784e-aa23-59cb-821b-d6d998ddccea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG64287',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 83087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Audi A4 40 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Saving data for AG64287: {'auction_closing_time': 1774886010.0, 'created_time': 1774638803.63396, 'last_price_update_time': 1774848831.496136}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG64287') HTTP/1.1" 204 0
2026-03-30 05:33:51 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-30 05:33:51 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Scrape type for VU33733: 0
2026-03-30 05:33:51 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Scrape type for FK95510: 2
2026-03-30 05:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf5010c6-80f6-562b-9a1d-87c7127c7de7 with identifier: FK95510
2026-03-30 05:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf5010c6-80f6-562b-9a1d-87c7127c7de7 with scrape type 2
2026-03-30 05:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf5010c6-80f6-562b-9a1d-87c7127c7de7 with scrape type 2
2026-03-30 05:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf5010c6-80f6-562b-9a1d-87c7127c7de7, identifier: FK95510
2026-03-30 05:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf5010c6-80f6-562b-9a1d-87c7127c7de7 with identifier: FK95510
2026-03-30 05:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf5010c6-80f6-562b-9a1d-87c7127c7de7 with identifier: FK95510
2026-03-30 05:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf5010c6-80f6-562b-9a1d-87c7127c7de7 with identifier: FK95510 to the API
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': 'bf5010c6-80f6-562b-9a1d-87c7127c7de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK95510',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 106925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-30 05:33:51 [auto1.de] INFO: Saving data for FK95510: {'auction_closing_time': 1774883730.0, 'created_time': 1774636678.443153, 'last_price_update_time': 1774848831.891212}
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK95510') HTTP/1.1" 204 0
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Scrape type for MY48468: 2
2026-03-30 05:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdff466a-7cdf-5da1-8581-b771ad9c538d with identifier: MY48468
2026-03-30 05:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdff466a-7cdf-5da1-8581-b771ad9c538d with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdff466a-7cdf-5da1-8581-b771ad9c538d with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdff466a-7cdf-5da1-8581-b771ad9c538d, identifier: MY48468
2026-03-30 05:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdff466a-7cdf-5da1-8581-b771ad9c538d with identifier: MY48468
2026-03-30 05:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdff466a-7cdf-5da1-8581-b771ad9c538d with identifier: MY48468
2026-03-30 05:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdff466a-7cdf-5da1-8581-b771ad9c538d with identifier: MY48468 to the API
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:12:05Z',
 'fuel_type': 'diesel',
 'id': 'bdff466a-7cdf-5da1-8581-b771ad9c538d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY48468',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 49315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-08',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Saving data for MY48468: {'auction_closing_time': 1774883525.0, 'created_time': 1773428375.035104, 'last_price_update_time': 1774848832.384605}
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY48468') HTTP/1.1" 204 0
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Scrape type for MF75644: 2
2026-03-30 05:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6fabeeb-06bc-5912-b1f5-6a7add059066 with identifier: MF75644
2026-03-30 05:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6fabeeb-06bc-5912-b1f5-6a7add059066 with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6fabeeb-06bc-5912-b1f5-6a7add059066 with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6fabeeb-06bc-5912-b1f5-6a7add059066, identifier: MF75644
2026-03-30 05:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6fabeeb-06bc-5912-b1f5-6a7add059066 with identifier: MF75644
2026-03-30 05:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6fabeeb-06bc-5912-b1f5-6a7add059066 with identifier: MF75644
2026-03-30 05:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6fabeeb-06bc-5912-b1f5-6a7add059066 with identifier: MF75644 to the API
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:48:40Z',
 'fuel_type': 'petrol',
 'id': 'b6fabeeb-06bc-5912-b1f5-6a7add059066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF75644',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 148600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2014}
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Saving data for MF75644: {'auction_closing_time': 1774885720.0, 'created_time': 1774636762.229885, 'last_price_update_time': 1774848832.797192}
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF75644') HTTP/1.1" 204 0
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-30 05:33:52 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-30 05:33:52 [auto1.de] INFO: Scrape type for BS37801: 2
2026-03-30 05:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f849d59-0ce5-5f42-b31a-1747723d381b with identifier: BS37801
2026-03-30 05:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f849d59-0ce5-5f42-b31a-1747723d381b with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f849d59-0ce5-5f42-b31a-1747723d381b with scrape type 2
2026-03-30 05:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f849d59-0ce5-5f42-b31a-1747723d381b, identifier: BS37801
2026-03-30 05:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f849d59-0ce5-5f42-b31a-1747723d381b with identifier: BS37801
2026-03-30 05:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f849d59-0ce5-5f42-b31a-1747723d381b with identifier: BS37801
2026-03-30 05:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f849d59-0ce5-5f42-b31a-1747723d381b with identifier: BS37801 to the API
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-30T15:56:07Z',
 'fuel_type': 'diesel',
 'id': '4f849d59-0ce5-5f42-b31a-1747723d381b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS37801',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 365089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-30',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-30 05:33:53 [auto1.de] INFO: Saving data for BS37801: {'auction_closing_time': 1774886167.0, 'created_time': 1774032264.118, 'last_price_update_time': 1774848833.213547}
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS37801') HTTP/1.1" 204 0
2026-03-30 05:33:53 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-30 05:33:53 [auto1.de] INFO: Scrape type for UC57196: 2
2026-03-30 05:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with identifier: UC57196
2026-03-30 05:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with scrape type 2
2026-03-30 05:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with scrape type 2
2026-03-30 05:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80a57dc9-b8c1-5e15-a2c4-282a60b455ef, identifier: UC57196
2026-03-30 05:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with identifier: UC57196
2026-03-30 05:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with identifier: UC57196
2026-03-30 05:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80a57dc9-b8c1-5e15-a2c4-282a60b455ef with identifier: UC57196 to the API
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'petrol',
 'id': '80a57dc9-b8c1-5e15-a2c4-282a60b455ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC57196',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-30 05:33:53 [auto1.de] INFO: Saving data for UC57196: {'auction_closing_time': 1774885613.0, 'created_time': 1774637547.753366, 'last_price_update_time': 1774848833.71072}
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC57196') HTTP/1.1" 204 0
2026-03-30 05:33:53 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-30 05:33:53 [auto1.de] INFO: Scrape type for GG93130: 2
2026-03-30 05:33:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de3fa77-3ee8-5163-9423-d77468fa684c with identifier: GG93130
2026-03-30 05:33:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de3fa77-3ee8-5163-9423-d77468fa684c with scrape type 2
2026-03-30 05:33:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de3fa77-3ee8-5163-9423-d77468fa684c with scrape type 2
2026-03-30 05:33:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de3fa77-3ee8-5163-9423-d77468fa684c, identifier: GG93130
2026-03-30 05:33:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de3fa77-3ee8-5163-9423-d77468fa684c with identifier: GG93130
2026-03-30 05:33:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de3fa77-3ee8-5163-9423-d77468fa684c with identifier: GG93130
2026-03-30 05:33:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de3fa77-3ee8-5163-9423-d77468fa684c with identifier: GG93130 to the API
2026-03-30 05:33:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:51Z',
 'fuel_type': 'petrol',
 'id': '1de3fa77-3ee8-5163-9423-d77468fa684c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG93130',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2015}
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Saving data for GG93130: {'auction_closing_time': 1774883871.0, 'created_time': 1774637117.32803, 'last_price_update_time': 1774848834.112993}
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG93130') HTTP/1.1" 204 0
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Scrape type for TU08005: 0
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Scrape type for UC31654: 2
2026-03-30 05:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5851b182-5755-57d5-a924-71e7110c16f7 with identifier: UC31654
2026-03-30 05:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5851b182-5755-57d5-a924-71e7110c16f7 with scrape type 2
2026-03-30 05:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5851b182-5755-57d5-a924-71e7110c16f7 with scrape type 2
2026-03-30 05:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5851b182-5755-57d5-a924-71e7110c16f7, identifier: UC31654
2026-03-30 05:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5851b182-5755-57d5-a924-71e7110c16f7 with identifier: UC31654
2026-03-30 05:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5851b182-5755-57d5-a924-71e7110c16f7 with identifier: UC31654
2026-03-30 05:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5851b182-5755-57d5-a924-71e7110c16f7 with identifier: UC31654 to the API
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:36:01Z',
 'fuel_type': 'petrol',
 'id': '5851b182-5755-57d5-a924-71e7110c16f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC31654',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 74499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Saving data for UC31654: {'auction_closing_time': 1774884961.0, 'created_time': 1774639497.800138, 'last_price_update_time': 1774848834.590991}
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC31654') HTTP/1.1" 204 0
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-30 05:33:54 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-30 05:33:54 [auto1.de] INFO: Scrape type for CD76809: 2
2026-03-30 05:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03b6df28-85a8-5926-998e-9006e82c9121 with identifier: CD76809
2026-03-30 05:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03b6df28-85a8-5926-998e-9006e82c9121 with scrape type 2
2026-03-30 05:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03b6df28-85a8-5926-998e-9006e82c9121 with scrape type 2
2026-03-30 05:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03b6df28-85a8-5926-998e-9006e82c9121, identifier: CD76809
2026-03-30 05:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03b6df28-85a8-5926-998e-9006e82c9121 with identifier: CD76809
2026-03-30 05:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03b6df28-85a8-5926-998e-9006e82c9121 with identifier: CD76809
2026-03-30 05:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03b6df28-85a8-5926-998e-9006e82c9121 with identifier: CD76809 to the API
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:17:43Z',
 'fuel_type': 'diesel',
 'id': '03b6df28-85a8-5926-998e-9006e82c9121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD76809',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 362062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-25',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 120 L4',
 'transmission': 'manual',
 'trim': '120 L4',
 'year': 2011}
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Saving data for CD76809: {'auction_closing_time': 1774883863.0, 'created_time': 1773992650.044415, 'last_price_update_time': 1774848835.084413}
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD76809') HTTP/1.1" 204 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-30 05:33:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:55 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for GJ42738: 2
2026-03-30 05:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with identifier: GJ42738
2026-03-30 05:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with scrape type 2
2026-03-30 05:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with scrape type 2
2026-03-30 05:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97fa5f94-3460-50fc-8b87-7af9a70b1ae4, identifier: GJ42738
2026-03-30 05:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with identifier: GJ42738
2026-03-30 05:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with identifier: GJ42738
2026-03-30 05:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97fa5f94-3460-50fc-8b87-7af9a70b1ae4 with identifier: GJ42738 to the API
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:33:34Z',
 'fuel_type': 'petrol',
 'id': '97fa5f94-3460-50fc-8b87-7af9a70b1ae4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ42738',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 214224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Saving data for GJ42738: {'auction_closing_time': 1774884814.0, 'created_time': 1774637355.813309, 'last_price_update_time': 1774848835.717018}
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ42738') HTTP/1.1" 204 0
2026-03-30 05:33:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for AA46272: 0
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-30 05:33:55 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-30 05:33:55 [auto1.de] INFO: Scrape type for ZT53548: 2
2026-03-30 05:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d833399-7680-586d-8713-9463cb58123d with identifier: ZT53548
2026-03-30 05:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d833399-7680-586d-8713-9463cb58123d with scrape type 2
2026-03-30 05:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d833399-7680-586d-8713-9463cb58123d with scrape type 2
2026-03-30 05:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d833399-7680-586d-8713-9463cb58123d, identifier: ZT53548
2026-03-30 05:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d833399-7680-586d-8713-9463cb58123d with identifier: ZT53548
2026-03-30 05:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d833399-7680-586d-8713-9463cb58123d with identifier: ZT53548
2026-03-30 05:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d833399-7680-586d-8713-9463cb58123d with identifier: ZT53548 to the API
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:41Z',
 'fuel_type': 'diesel',
 'id': '5d833399-7680-586d-8713-9463cb58123d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT53548',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 191792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Saving data for ZT53548: {'auction_closing_time': 1774883321.0, 'created_time': 1774639341.893687, 'last_price_update_time': 1774848836.273867}
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT53548') HTTP/1.1" 204 0
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Scrape type for RL19832: 2
2026-03-30 05:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4f14450-7c75-50ad-a69a-235c92b8b245 with identifier: RL19832
2026-03-30 05:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4f14450-7c75-50ad-a69a-235c92b8b245 with scrape type 2
2026-03-30 05:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4f14450-7c75-50ad-a69a-235c92b8b245 with scrape type 2
2026-03-30 05:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4f14450-7c75-50ad-a69a-235c92b8b245, identifier: RL19832
2026-03-30 05:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4f14450-7c75-50ad-a69a-235c92b8b245 with identifier: RL19832
2026-03-30 05:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4f14450-7c75-50ad-a69a-235c92b8b245 with identifier: RL19832
2026-03-30 05:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4f14450-7c75-50ad-a69a-235c92b8b245 with identifier: RL19832 to the API
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:39:31Z',
 'fuel_type': 'petrol',
 'id': 'b4f14450-7c75-50ad-a69a-235c92b8b245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL19832',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 85841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Saving data for RL19832: {'auction_closing_time': 1774885171.0, 'created_time': 1774638744.841807, 'last_price_update_time': 1774848836.8315}
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL19832') HTTP/1.1" 204 0
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-30 05:33:56 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-30 05:33:56 [auto1.de] INFO: Scrape type for FB02841: 2
2026-03-30 05:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51c30a1c-b4c7-57e4-8305-306f94932fd5 with identifier: FB02841
2026-03-30 05:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51c30a1c-b4c7-57e4-8305-306f94932fd5 with scrape type 2
2026-03-30 05:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51c30a1c-b4c7-57e4-8305-306f94932fd5 with scrape type 2
2026-03-30 05:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51c30a1c-b4c7-57e4-8305-306f94932fd5, identifier: FB02841
2026-03-30 05:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51c30a1c-b4c7-57e4-8305-306f94932fd5 with identifier: FB02841
2026-03-30 05:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51c30a1c-b4c7-57e4-8305-306f94932fd5 with identifier: FB02841
2026-03-30 05:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51c30a1c-b4c7-57e4-8305-306f94932fd5 with identifier: FB02841 to the API
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:33:34Z',
 'fuel_type': 'diesel',
 'id': '51c30a1c-b4c7-57e4-8305-306f94932fd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB02841',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 216193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-14',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Saving data for FB02841: {'auction_closing_time': 1774884814.0, 'created_time': 1774636847.429139, 'last_price_update_time': 1774848837.224489}
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB02841') HTTP/1.1" 204 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for PW12132: 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for NT04254: 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for CL62984: 2
2026-03-30 05:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with identifier: CL62984
2026-03-30 05:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with scrape type 2
2026-03-30 05:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with scrape type 2
2026-03-30 05:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8, identifier: CL62984
2026-03-30 05:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with identifier: CL62984
2026-03-30 05:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with identifier: CL62984
2026-03-30 05:33:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8 with identifier: CL62984 to the API
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:22:22Z',
 'fuel_type': 'petrol',
 'id': '7868a9fb-9b5f-5c2b-8e31-4ec0dbfc55c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL62984',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 19485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Saving data for CL62984: {'auction_closing_time': 1774884142.0, 'created_time': 1774638285.932135, 'last_price_update_time': 1774848837.67136}
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL62984') HTTP/1.1" 204 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-30 05:33:57 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-30 05:33:57 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 05:33:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:33:58 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6742 | hits on page: 40
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for FP33840: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for CM74095: 2
2026-03-30 05:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 054a5557-82d1-55f1-aa9b-2b6511a140e4 with identifier: CM74095
2026-03-30 05:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 054a5557-82d1-55f1-aa9b-2b6511a140e4 with scrape type 2
2026-03-30 05:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 054a5557-82d1-55f1-aa9b-2b6511a140e4 with scrape type 2
2026-03-30 05:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 054a5557-82d1-55f1-aa9b-2b6511a140e4, identifier: CM74095
2026-03-30 05:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 054a5557-82d1-55f1-aa9b-2b6511a140e4 with identifier: CM74095
2026-03-30 05:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 054a5557-82d1-55f1-aa9b-2b6511a140e4 with identifier: CM74095
2026-03-30 05:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 054a5557-82d1-55f1-aa9b-2b6511a140e4 with identifier: CM74095 to the API
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:35:29Z',
 'fuel_type': 'petrol',
 'id': '054a5557-82d1-55f1-aa9b-2b6511a140e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM74095',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 14834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-16',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT Convertible',
 'transmission': 'automatic',
 'trim': 'GT Convertible',
 'year': 2022}
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Saving data for CM74095: {'auction_closing_time': 1774884929.0, 'created_time': 1774639307.110047, 'last_price_update_time': 1774848838.849363}
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM74095') HTTP/1.1" 204 0
2026-03-30 05:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for LM10122: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for VU50436: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-30 05:33:58 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-30 05:33:58 [auto1.de] INFO: Scrape type for FC83292: 2
2026-03-30 05:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c05cd593-28c0-5d40-a4e1-1c49551bfa84 with identifier: FC83292
2026-03-30 05:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05cd593-28c0-5d40-a4e1-1c49551bfa84 with scrape type 2
2026-03-30 05:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c05cd593-28c0-5d40-a4e1-1c49551bfa84 with scrape type 2
2026-03-30 05:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c05cd593-28c0-5d40-a4e1-1c49551bfa84, identifier: FC83292
2026-03-30 05:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c05cd593-28c0-5d40-a4e1-1c49551bfa84 with identifier: FC83292
2026-03-30 05:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c05cd593-28c0-5d40-a4e1-1c49551bfa84 with identifier: FC83292
2026-03-30 05:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c05cd593-28c0-5d40-a4e1-1c49551bfa84 with identifier: FC83292 to the API
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:45Z',
 'fuel_type': 'petrol',
 'id': 'c05cd593-28c0-5d40-a4e1-1c49551bfa84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC83292',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 15757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo 120 Jahre',
 'transmission': 'automatic',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-30 05:33:59 [auto1.de] INFO: Saving data for FC83292: {'auction_closing_time': 1774885425.0, 'created_time': 1774637245.549771, 'last_price_update_time': 1774848839.325375}
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC83292') HTTP/1.1" 204 0
2026-03-30 05:33:59 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 05:33:59 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-30 05:33:59 [auto1.de] INFO: Scrape type for GN89832: 2
2026-03-30 05:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62260c56-acb2-5cca-89d5-b4bd5ab572ea with identifier: GN89832
2026-03-30 05:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62260c56-acb2-5cca-89d5-b4bd5ab572ea with scrape type 2
2026-03-30 05:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62260c56-acb2-5cca-89d5-b4bd5ab572ea with scrape type 2
2026-03-30 05:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62260c56-acb2-5cca-89d5-b4bd5ab572ea, identifier: GN89832
2026-03-30 05:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62260c56-acb2-5cca-89d5-b4bd5ab572ea with identifier: GN89832
2026-03-30 05:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62260c56-acb2-5cca-89d5-b4bd5ab572ea with identifier: GN89832
2026-03-30 05:33:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62260c56-acb2-5cca-89d5-b4bd5ab572ea with identifier: GN89832 to the API
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'diesel',
 'id': '62260c56-acb2-5cca-89d5-b4bd5ab572ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN89832',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 195062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-01',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-30 05:33:59 [auto1.de] INFO: Saving data for GN89832: {'auction_closing_time': 1774885650.0, 'created_time': 1774380352.066379, 'last_price_update_time': 1774848839.809779}
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN89832') HTTP/1.1" 204 0
2026-03-30 05:33:59 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-30 05:33:59 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-30 05:33:59 [auto1.de] INFO: Scrape type for GJ82118: 2
2026-03-30 05:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-30 05:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with scrape type 2
2026-03-30 05:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with scrape type 2
2026-03-30 05:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1, identifier: GJ82118
2026-03-30 05:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-30 05:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118
2026-03-30 05:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1 with identifier: GJ82118 to the API
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:40:56Z',
 'fuel_type': 'diesel',
 'id': '3cc0a11d-b9dd-5ad9-bbce-189142b8b4c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ82118',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 153606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Multivan',
 'transmission': 'automatic',
 'trim': 'Multivan',
 'year': 2012}
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-30 05:34:00 [auto1.de] INFO: Saving data for GJ82118: {'auction_closing_time': 1774885256.0, 'created_time': 1774551859.088054, 'last_price_update_time': 1774848840.243906}
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ82118') HTTP/1.1" 204 0
2026-03-30 05:34:00 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-30 05:34:00 [auto1.de] INFO: Scrape type for HB62696: 0
2026-03-30 05:34:00 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-30 05:34:00 [auto1.de] INFO: Scrape type for UP66494: 2
2026-03-30 05:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7f09808-d912-5461-9429-6362836a9070 with identifier: UP66494
2026-03-30 05:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f09808-d912-5461-9429-6362836a9070 with scrape type 2
2026-03-30 05:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7f09808-d912-5461-9429-6362836a9070 with scrape type 2
2026-03-30 05:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7f09808-d912-5461-9429-6362836a9070, identifier: UP66494
2026-03-30 05:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7f09808-d912-5461-9429-6362836a9070 with identifier: UP66494
2026-03-30 05:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7f09808-d912-5461-9429-6362836a9070 with identifier: UP66494
2026-03-30 05:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7f09808-d912-5461-9429-6362836a9070 with identifier: UP66494 to the API
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'diesel',
 'id': 'd7f09808-d912-5461-9429-6362836a9070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP66494',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 165555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-30 05:34:00 [auto1.de] INFO: Saving data for UP66494: {'auction_closing_time': 1774885759.0, 'created_time': 1774636314.116463, 'last_price_update_time': 1774848840.66773}
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP66494') HTTP/1.1" 204 0
2026-03-30 05:34:00 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-30 05:34:00 [auto1.de] INFO: Scrape type for BF27156: 2
2026-03-30 05:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96be15e5-7f6c-5f25-bf8a-86f465188be4 with identifier: BF27156
2026-03-30 05:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96be15e5-7f6c-5f25-bf8a-86f465188be4 with scrape type 2
2026-03-30 05:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96be15e5-7f6c-5f25-bf8a-86f465188be4 with scrape type 2
2026-03-30 05:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96be15e5-7f6c-5f25-bf8a-86f465188be4, identifier: BF27156
2026-03-30 05:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96be15e5-7f6c-5f25-bf8a-86f465188be4 with identifier: BF27156
2026-03-30 05:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96be15e5-7f6c-5f25-bf8a-86f465188be4 with identifier: BF27156
2026-03-30 05:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96be15e5-7f6c-5f25-bf8a-86f465188be4 with identifier: BF27156 to the API
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:16:14Z',
 'fuel_type': 'petrol',
 'id': '96be15e5-7f6c-5f25-bf8a-86f465188be4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF27156',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 178153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-12-31',
 'seller_name': None,
 'title': 'Audi A3 1.8 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2000}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Saving data for BF27156: {'auction_closing_time': 1774883774.0, 'created_time': 1774639468.674098, 'last_price_update_time': 1774848841.092752}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF27156') HTTP/1.1" 204 0
2026-03-30 05:34:01 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-30 05:34:01 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-30 05:34:01 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Scrape type for DR38241: 2
2026-03-30 05:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with identifier: DR38241
2026-03-30 05:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with scrape type 2
2026-03-30 05:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with scrape type 2
2026-03-30 05:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4a6fccf-a729-5ced-974c-6ef2a72bbd16, identifier: DR38241
2026-03-30 05:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with identifier: DR38241
2026-03-30 05:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with identifier: DR38241
2026-03-30 05:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4a6fccf-a729-5ced-974c-6ef2a72bbd16 with identifier: DR38241 to the API
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:06:36Z',
 'fuel_type': 'petrol',
 'id': 'e4a6fccf-a729-5ced-974c-6ef2a72bbd16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR38241',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 159762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-06',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Saving data for DR38241: {'auction_closing_time': 1774883196.0, 'created_time': 1773307724.414201, 'last_price_update_time': 1774848841.520181}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR38241') HTTP/1.1" 204 0
2026-03-30 05:34:01 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-30 05:34:01 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Scrape type for KE52706: 2
2026-03-30 05:34:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-30 05:34:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa3eba1-3705-5202-8838-deeabf5f0e04 with scrape type 2
2026-03-30 05:34:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa3eba1-3705-5202-8838-deeabf5f0e04 with scrape type 2
2026-03-30 05:34:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aa3eba1-3705-5202-8838-deeabf5f0e04, identifier: KE52706
2026-03-30 05:34:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-30 05:34:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706
2026-03-30 05:34:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aa3eba1-3705-5202-8838-deeabf5f0e04 with identifier: KE52706 to the API
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'petrol',
 'id': '8aa3eba1-3705-5202-8838-deeabf5f0e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE52706',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 67280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-30 05:34:01 [auto1.de] INFO: Saving data for KE52706: {'auction_closing_time': 1774883989.0, 'created_time': 1774552701.799171, 'last_price_update_time': 1774848841.934392}
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE52706') HTTP/1.1" 204 0
2026-03-30 05:34:02 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-30 05:34:02 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-30 05:34:02 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-30 05:34:02 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-30 05:34:02 [auto1.de] INFO: Scrape type for BP78735: 2
2026-03-30 05:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e1256a8-994a-5ef4-834a-5b14175446ea with identifier: BP78735
2026-03-30 05:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e1256a8-994a-5ef4-834a-5b14175446ea with scrape type 2
2026-03-30 05:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e1256a8-994a-5ef4-834a-5b14175446ea with scrape type 2
2026-03-30 05:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e1256a8-994a-5ef4-834a-5b14175446ea, identifier: BP78735
2026-03-30 05:34:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e1256a8-994a-5ef4-834a-5b14175446ea with identifier: BP78735
2026-03-30 05:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e1256a8-994a-5ef4-834a-5b14175446ea with identifier: BP78735
2026-03-30 05:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e1256a8-994a-5ef4-834a-5b14175446ea with identifier: BP78735 to the API
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'diesel',
 'id': '7e1256a8-994a-5ef4-834a-5b14175446ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP78735',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 5',
 'odometer': 91227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'Land Rover Discovery 5 3.0 SD V6 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2020}
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-30 05:34:02 [auto1.de] INFO: Saving data for BP78735: {'auction_closing_time': 1774886122.0, 'created_time': 1774636470.005503, 'last_price_update_time': 1774848842.45049}
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP78735') HTTP/1.1" 204 0
2026-03-30 05:34:02 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-30 05:34:02 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-30 05:34:02 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-30 05:34:02 [auto1.de] INFO: Scrape type for YP61369: 2
2026-03-30 05:34:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e705f05-af2b-52b7-b630-5ec2e643439f with identifier: YP61369
2026-03-30 05:34:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e705f05-af2b-52b7-b630-5ec2e643439f with scrape type 2
2026-03-30 05:34:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e705f05-af2b-52b7-b630-5ec2e643439f with scrape type 2
2026-03-30 05:34:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e705f05-af2b-52b7-b630-5ec2e643439f, identifier: YP61369
2026-03-30 05:34:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e705f05-af2b-52b7-b630-5ec2e643439f with identifier: YP61369
2026-03-30 05:34:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e705f05-af2b-52b7-b630-5ec2e643439f with identifier: YP61369
2026-03-30 05:34:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e705f05-af2b-52b7-b630-5ec2e643439f with identifier: YP61369 to the API
2026-03-30 05:34:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'petrol',
 'id': '1e705f05-af2b-52b7-b630-5ec2e643439f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP61369',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka+',
 'odometer': 28060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-11',
 'seller_name': None,
 'title': 'Ford Ka+ 1.2 Ti-VCT Cool&Sound',
 'transmission': 'manual',
 'trim': 'Cool&Sound',
 'year': 2018}
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-30 05:34:03 [auto1.de] INFO: Saving data for YP61369: {'auction_closing_time': 1774885534.0, 'created_time': 1773427016.069775, 'last_price_update_time': 1774848843.843915}
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP61369') HTTP/1.1" 204 0
2026-03-30 05:34:03 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-30 05:34:03 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-30 05:34:03 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-30 05:34:03 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-30 05:34:03 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-30 05:34:03 [auto1.de] INFO: Scrape type for NC36065: 2
2026-03-30 05:34:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1f432b-eef0-5006-986e-0d6e54e0e71b with identifier: NC36065
2026-03-30 05:34:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1f432b-eef0-5006-986e-0d6e54e0e71b with scrape type 2
2026-03-30 05:34:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1f432b-eef0-5006-986e-0d6e54e0e71b with scrape type 2
2026-03-30 05:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f1f432b-eef0-5006-986e-0d6e54e0e71b, identifier: NC36065
2026-03-30 05:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f1f432b-eef0-5006-986e-0d6e54e0e71b with identifier: NC36065
2026-03-30 05:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f1f432b-eef0-5006-986e-0d6e54e0e71b with identifier: NC36065
2026-03-30 05:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f1f432b-eef0-5006-986e-0d6e54e0e71b with identifier: NC36065 to the API
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:02:14Z',
 'fuel_type': 'petrol',
 'id': '7f1f432b-eef0-5006-986e-0d6e54e0e71b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC36065',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 129784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Laureate 4x2',
 'transmission': 'manual',
 'trim': 'Laureate 4x2',
 'year': 2015}
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-30 05:34:04 [auto1.de] INFO: Saving data for NC36065: {'auction_closing_time': 1774882934.0, 'created_time': 1774032868.108825, 'last_price_update_time': 1774848844.295675}
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC36065') HTTP/1.1" 204 0
2026-03-30 05:34:04 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:04 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-30 05:34:04 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-30 05:34:04 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-30 05:34:04 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-30 05:34:04 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-30 05:34:04 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-30 05:34:04 [auto1.de] INFO: Scrape type for ET79003: 2
2026-03-30 05:34:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edccc82e-c037-5db5-8796-e39c143e2bf3 with identifier: ET79003
2026-03-30 05:34:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edccc82e-c037-5db5-8796-e39c143e2bf3 with scrape type 2
2026-03-30 05:34:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edccc82e-c037-5db5-8796-e39c143e2bf3 with scrape type 2
2026-03-30 05:34:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edccc82e-c037-5db5-8796-e39c143e2bf3, identifier: ET79003
2026-03-30 05:34:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edccc82e-c037-5db5-8796-e39c143e2bf3 with identifier: ET79003
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 05:34:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:34:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edccc82e-c037-5db5-8796-e39c143e2bf3 with identifier: ET79003
2026-03-30 05:34:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edccc82e-c037-5db5-8796-e39c143e2bf3 with identifier: ET79003 to the API
2026-03-30 05:34:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:15:26Z',
 'fuel_type': 'petrol',
 'id': 'edccc82e-c037-5db5-8796-e39c143e2bf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET79003',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 120422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 X-TRA',
 'transmission': 'manual',
 'trim': 'X-TRA',
 'year': 2015}
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Saving data for ET79003: {'auction_closing_time': 1774883726.0, 'created_time': 1774637107.923419, 'last_price_update_time': 1774848845.359198}
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET79003') HTTP/1.1" 204 0
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Scrape type for WY09596: 2
2026-03-30 05:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0c69632-13dc-5262-82a9-f8bd04bbc20d with identifier: WY09596
2026-03-30 05:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0c69632-13dc-5262-82a9-f8bd04bbc20d with scrape type 2
2026-03-30 05:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0c69632-13dc-5262-82a9-f8bd04bbc20d with scrape type 2
2026-03-30 05:34:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0c69632-13dc-5262-82a9-f8bd04bbc20d, identifier: WY09596
2026-03-30 05:34:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-30 05:34:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0c69632-13dc-5262-82a9-f8bd04bbc20d with identifier: WY09596
2026-03-30 05:34:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0c69632-13dc-5262-82a9-f8bd04bbc20d with identifier: WY09596
2026-03-30 05:34:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0c69632-13dc-5262-82a9-f8bd04bbc20d with identifier: WY09596 to the API
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:28Z',
 'fuel_type': 'diesel',
 'id': 'b0c69632-13dc-5262-82a9-f8bd04bbc20d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY09596',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 171491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-08',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Saving data for WY09596: {'auction_closing_time': 1774885468.0, 'created_time': 1774639217.091502, 'last_price_update_time': 1774848845.877362}
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY09596') HTTP/1.1" 204 0
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 05:34:05 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-30 05:34:05 [auto1.de] INFO: Scrape type for LM85706: 2
2026-03-30 05:34:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc1bfc9f-1f22-5477-9dde-f7aebf048239 with identifier: LM85706
2026-03-30 05:34:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc1bfc9f-1f22-5477-9dde-f7aebf048239 with scrape type 2
2026-03-30 05:34:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc1bfc9f-1f22-5477-9dde-f7aebf048239 with scrape type 2
2026-03-30 05:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc1bfc9f-1f22-5477-9dde-f7aebf048239, identifier: LM85706
2026-03-30 05:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc1bfc9f-1f22-5477-9dde-f7aebf048239 with identifier: LM85706
2026-03-30 05:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc1bfc9f-1f22-5477-9dde-f7aebf048239 with identifier: LM85706
2026-03-30 05:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc1bfc9f-1f22-5477-9dde-f7aebf048239 with identifier: LM85706 to the API
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:46Z',
 'fuel_type': 'diesel',
 'id': 'cc1bfc9f-1f22-5477-9dde-f7aebf048239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM85706',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 160157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Saving data for LM85706: {'auction_closing_time': 1774886386.0, 'created_time': 1774638812.268466, 'last_price_update_time': 1774848846.292553}
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM85706') HTTP/1.1" 204 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for NM50493: 2
2026-03-30 05:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b31ff140-bf9c-5588-a0db-287d064afea0 with identifier: NM50493
2026-03-30 05:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b31ff140-bf9c-5588-a0db-287d064afea0 with scrape type 2
2026-03-30 05:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b31ff140-bf9c-5588-a0db-287d064afea0 with scrape type 2
2026-03-30 05:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b31ff140-bf9c-5588-a0db-287d064afea0, identifier: NM50493
2026-03-30 05:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b31ff140-bf9c-5588-a0db-287d064afea0 with identifier: NM50493
2026-03-30 05:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b31ff140-bf9c-5588-a0db-287d064afea0 with identifier: NM50493
2026-03-30 05:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b31ff140-bf9c-5588-a0db-287d064afea0 with identifier: NM50493 to the API
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:00:51Z',
 'fuel_type': 'diesel',
 'id': 'b31ff140-bf9c-5588-a0db-287d064afea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM50493',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 175018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-09',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 dCi Energy Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2019}
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Saving data for NM50493: {'auction_closing_time': 1774882851.0, 'created_time': 1773830257.446761, 'last_price_update_time': 1774848846.712854}
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM50493') HTTP/1.1" 204 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for KN80130: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for RU25678: 0
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-30 05:34:06 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-30 05:34:06 [auto1.de] INFO: Scrape type for ZM88762: 2
2026-03-30 05:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783a0f6b-4a41-5cb5-8599-61068667e662 with identifier: ZM88762
2026-03-30 05:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783a0f6b-4a41-5cb5-8599-61068667e662 with scrape type 2
2026-03-30 05:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 783a0f6b-4a41-5cb5-8599-61068667e662 with scrape type 2
2026-03-30 05:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 783a0f6b-4a41-5cb5-8599-61068667e662, identifier: ZM88762
2026-03-30 05:34:07 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 7 pages/min), scraped 191 items (at 52 items/min)
2026-03-30 05:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 783a0f6b-4a41-5cb5-8599-61068667e662 with identifier: ZM88762
2026-03-30 05:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 783a0f6b-4a41-5cb5-8599-61068667e662 with identifier: ZM88762
2026-03-30 05:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 783a0f6b-4a41-5cb5-8599-61068667e662 with identifier: ZM88762 to the API
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:59Z',
 'fuel_type': 'diesel',
 'id': '783a0f6b-4a41-5cb5-8599-61068667e662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM88762',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 110312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-06',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Saving data for ZM88762: {'auction_closing_time': 1774886159.0, 'created_time': 1774636527.835722, 'last_price_update_time': 1774848847.337781}
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM88762') HTTP/1.1" 204 0
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 05:34:07 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Scrape type for JZ68133: 2
2026-03-30 05:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with identifier: JZ68133
2026-03-30 05:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with scrape type 2
2026-03-30 05:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with scrape type 2
2026-03-30 05:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e6ebc1e-4d2b-5cb4-ac86-832028cff705, identifier: JZ68133
2026-03-30 05:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with identifier: JZ68133
2026-03-30 05:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with identifier: JZ68133
2026-03-30 05:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e6ebc1e-4d2b-5cb4-ac86-832028cff705 with identifier: JZ68133 to the API
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:54:13Z',
 'fuel_type': 'diesel',
 'id': '0e6ebc1e-4d2b-5cb4-ac86-832028cff705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ68133',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 228488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2011}
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-30 05:34:07 [auto1.de] INFO: Saving data for JZ68133: {'auction_closing_time': 1774886053.0, 'created_time': 1774639225.467969, 'last_price_update_time': 1774848847.895497}
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ68133') HTTP/1.1" 204 0
2026-03-30 05:34:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:09 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-30 05:34:09 [auto1.de] INFO: Scrape type for YW15548: 2
2026-03-30 05:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 516d733c-b90a-5f23-b675-d398635db7c7 with identifier: YW15548
2026-03-30 05:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 516d733c-b90a-5f23-b675-d398635db7c7 with scrape type 2
2026-03-30 05:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 516d733c-b90a-5f23-b675-d398635db7c7 with scrape type 2
2026-03-30 05:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 516d733c-b90a-5f23-b675-d398635db7c7, identifier: YW15548
2026-03-30 05:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 516d733c-b90a-5f23-b675-d398635db7c7 with identifier: YW15548
2026-03-30 05:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 516d733c-b90a-5f23-b675-d398635db7c7 with identifier: YW15548
2026-03-30 05:34:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 516d733c-b90a-5f23-b675-d398635db7c7 with identifier: YW15548 to the API
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:48:36Z',
 'fuel_type': 'petrol',
 'id': '516d733c-b90a-5f23-b675-d398635db7c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW15548',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 179687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-08-05',
 'seller_name': None,
 'title': 'BMW 3er 320Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-30 05:34:09 [auto1.de] INFO: Saving data for YW15548: {'auction_closing_time': 1774885716.0, 'created_time': 1773400753.403477, 'last_price_update_time': 1774848849.8049}
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW15548') HTTP/1.1" 204 0
2026-03-30 05:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-30 05:34:09 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-30 05:34:09 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-30 05:34:09 [auto1.de] INFO: Scrape type for KW12270: 2
2026-03-30 05:34:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9401f98-3eb9-517d-b245-d79450d585e7 with identifier: KW12270
2026-03-30 05:34:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9401f98-3eb9-517d-b245-d79450d585e7 with scrape type 2
2026-03-30 05:34:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9401f98-3eb9-517d-b245-d79450d585e7 with scrape type 2
2026-03-30 05:34:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9401f98-3eb9-517d-b245-d79450d585e7, identifier: KW12270
2026-03-30 05:34:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9401f98-3eb9-517d-b245-d79450d585e7 with identifier: KW12270
2026-03-30 05:34:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9401f98-3eb9-517d-b245-d79450d585e7 with identifier: KW12270
2026-03-30 05:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9401f98-3eb9-517d-b245-d79450d585e7 with identifier: KW12270 to the API
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:27Z',
 'fuel_type': 'petrol',
 'id': 'b9401f98-3eb9-517d-b245-d79450d585e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW12270',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 58952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Saving data for KW12270: {'auction_closing_time': 1774884747.0, 'created_time': 1774638444.412909, 'last_price_update_time': 1774848850.23953}
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW12270') HTTP/1.1" 204 0
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Scrape type for DP90284: 2
2026-03-30 05:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97076bca-1822-5106-8d49-478dd2c2326e with identifier: DP90284
2026-03-30 05:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97076bca-1822-5106-8d49-478dd2c2326e with scrape type 2
2026-03-30 05:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97076bca-1822-5106-8d49-478dd2c2326e with scrape type 2
2026-03-30 05:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97076bca-1822-5106-8d49-478dd2c2326e, identifier: DP90284
2026-03-30 05:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97076bca-1822-5106-8d49-478dd2c2326e with identifier: DP90284
2026-03-30 05:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97076bca-1822-5106-8d49-478dd2c2326e with identifier: DP90284
2026-03-30 05:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97076bca-1822-5106-8d49-478dd2c2326e with identifier: DP90284 to the API
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'diesel',
 'id': '97076bca-1822-5106-8d49-478dd2c2326e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP90284',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 151972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-26',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Saving data for DP90284: {'auction_closing_time': 1774885474.0, 'created_time': 1774550047.562163, 'last_price_update_time': 1774848850.676311}
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP90284') HTTP/1.1" 204 0
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-30 05:34:10 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-30 05:34:10 [auto1.de] INFO: Scrape type for ME45713: 2
2026-03-30 05:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133177ac-116b-54a1-80b4-a5c506aa3292 with identifier: ME45713
2026-03-30 05:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133177ac-116b-54a1-80b4-a5c506aa3292 with scrape type 2
2026-03-30 05:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133177ac-116b-54a1-80b4-a5c506aa3292 with scrape type 2
2026-03-30 05:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 133177ac-116b-54a1-80b4-a5c506aa3292, identifier: ME45713
2026-03-30 05:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 133177ac-116b-54a1-80b4-a5c506aa3292 with identifier: ME45713
2026-03-30 05:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 133177ac-116b-54a1-80b4-a5c506aa3292 with identifier: ME45713
2026-03-30 05:34:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 133177ac-116b-54a1-80b4-a5c506aa3292 with identifier: ME45713 to the API
2026-03-30 05:34:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:48:20Z',
 'fuel_type': 'petrol',
 'id': '133177ac-116b-54a1-80b4-a5c506aa3292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME45713',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 167725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-08',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-30 05:34:11 [auto1.de] INFO: Saving data for ME45713: {'auction_closing_time': 1774885700.0, 'created_time': 1774637241.958174, 'last_price_update_time': 1774848851.193367}
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME45713') HTTP/1.1" 204 0
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-30 05:34:11 [auto1.de] INFO: Scrape type for UZ90391: 2
2026-03-30 05:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b194a5e8-fa9b-51da-b090-6ba0a4872c54 with identifier: UZ90391
2026-03-30 05:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b194a5e8-fa9b-51da-b090-6ba0a4872c54 with scrape type 2
2026-03-30 05:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b194a5e8-fa9b-51da-b090-6ba0a4872c54 with scrape type 2
2026-03-30 05:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b194a5e8-fa9b-51da-b090-6ba0a4872c54, identifier: UZ90391
2026-03-30 05:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b194a5e8-fa9b-51da-b090-6ba0a4872c54 with identifier: UZ90391
2026-03-30 05:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b194a5e8-fa9b-51da-b090-6ba0a4872c54 with identifier: UZ90391
2026-03-30 05:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b194a5e8-fa9b-51da-b090-6ba0a4872c54 with identifier: UZ90391 to the API
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:25:14Z',
 'fuel_type': 'diesel',
 'id': 'b194a5e8-fa9b-51da-b090-6ba0a4872c54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ90391',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 136302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueTEC Avantgarde',
 'year': 2014}
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-30 05:34:11 [auto1.de] INFO: Saving data for UZ90391: {'auction_closing_time': 1774884314.0, 'created_time': 1774639024.265392, 'last_price_update_time': 1774848851.625306}
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ90391') HTTP/1.1" 204 0
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-30 05:34:11 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-30 05:34:11 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-30 05:34:11 [auto1.de] INFO: Scrape type for RT10354: 2
2026-03-30 05:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63e6f91-4d99-57ec-85b8-1b514f7e1901 with identifier: RT10354
2026-03-30 05:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63e6f91-4d99-57ec-85b8-1b514f7e1901 with scrape type 2
2026-03-30 05:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63e6f91-4d99-57ec-85b8-1b514f7e1901 with scrape type 2
2026-03-30 05:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e63e6f91-4d99-57ec-85b8-1b514f7e1901, identifier: RT10354
2026-03-30 05:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e63e6f91-4d99-57ec-85b8-1b514f7e1901 with identifier: RT10354
2026-03-30 05:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e63e6f91-4d99-57ec-85b8-1b514f7e1901 with identifier: RT10354
2026-03-30 05:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e63e6f91-4d99-57ec-85b8-1b514f7e1901 with identifier: RT10354 to the API
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:47:42Z',
 'fuel_type': 'petrol',
 'id': 'e63e6f91-4d99-57ec-85b8-1b514f7e1901',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT10354',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 142199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-16',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Saving data for RT10354: {'auction_closing_time': 1774885662.0, 'created_time': 1774636743.129052, 'last_price_update_time': 1774848852.054439}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT10354') HTTP/1.1" 204 0
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Scrape type for KV78740: 0
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Scrape type for ZN20301: 2
2026-03-30 05:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1daac3c-9903-5b28-a8ed-916750e599f7 with identifier: ZN20301
2026-03-30 05:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1daac3c-9903-5b28-a8ed-916750e599f7 with scrape type 2
2026-03-30 05:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1daac3c-9903-5b28-a8ed-916750e599f7 with scrape type 2
2026-03-30 05:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1daac3c-9903-5b28-a8ed-916750e599f7, identifier: ZN20301
2026-03-30 05:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1daac3c-9903-5b28-a8ed-916750e599f7 with identifier: ZN20301
2026-03-30 05:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1daac3c-9903-5b28-a8ed-916750e599f7 with identifier: ZN20301
2026-03-30 05:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1daac3c-9903-5b28-a8ed-916750e599f7 with identifier: ZN20301 to the API
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:00Z',
 'fuel_type': 'petrol',
 'id': 'd1daac3c-9903-5b28-a8ed-916750e599f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN20301',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 119854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2012}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Saving data for ZN20301: {'auction_closing_time': 1774883280.0, 'created_time': 1773304012.244728, 'last_price_update_time': 1774848852.55153}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN20301') HTTP/1.1" 204 0
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Scrape type for WP28886: 2
2026-03-30 05:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-30 05:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7b052b4-6768-57a6-ab3d-960a199513ed with scrape type 2
2026-03-30 05:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7b052b4-6768-57a6-ab3d-960a199513ed with scrape type 2
2026-03-30 05:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7b052b4-6768-57a6-ab3d-960a199513ed, identifier: WP28886
2026-03-30 05:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-30 05:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886
2026-03-30 05:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7b052b4-6768-57a6-ab3d-960a199513ed with identifier: WP28886 to the API
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': 'b7b052b4-6768-57a6-ab3d-960a199513ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP28886',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 2658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Journey',
 'transmission': 'automatic',
 'trim': 'Journey',
 'year': 2025}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-30 05:34:12 [auto1.de] INFO: Saving data for WP28886: {'auction_closing_time': 1774885441.0, 'created_time': 1774553065.073039, 'last_price_update_time': 1774848852.964694}
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP28886') HTTP/1.1" 204 0
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-30 05:34:12 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-30 05:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Scrape type for EC78476: 2
2026-03-30 05:34:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee57fe4f-5956-512e-b53c-a968593178b2 with identifier: EC78476
2026-03-30 05:34:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee57fe4f-5956-512e-b53c-a968593178b2 with scrape type 2
2026-03-30 05:34:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee57fe4f-5956-512e-b53c-a968593178b2 with scrape type 2
2026-03-30 05:34:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee57fe4f-5956-512e-b53c-a968593178b2, identifier: EC78476
2026-03-30 05:34:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee57fe4f-5956-512e-b53c-a968593178b2 with identifier: EC78476
2026-03-30 05:34:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee57fe4f-5956-512e-b53c-a968593178b2 with identifier: EC78476
2026-03-30 05:34:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee57fe4f-5956-512e-b53c-a968593178b2 with identifier: EC78476 to the API
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'diesel',
 'id': 'ee57fe4f-5956-512e-b53c-a968593178b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC78476',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 235141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Saving data for EC78476: {'auction_closing_time': 1774885579.0, 'created_time': 1774637236.743229, 'last_price_update_time': 1774848853.425251}
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC78476') HTTP/1.1" 204 0
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-30 05:34:13 [auto1.de] INFO: Scrape type for BA95413: 0
2026-03-30 05:34:13 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-30 05:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:15 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:15 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-30 05:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-30 05:34:15 [auto1.de] INFO: Scrape type for RE63795: 2
2026-03-30 05:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14593153-fc07-5f81-a12d-88be6b943444 with identifier: RE63795
2026-03-30 05:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14593153-fc07-5f81-a12d-88be6b943444 with scrape type 2
2026-03-30 05:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14593153-fc07-5f81-a12d-88be6b943444 with scrape type 2
2026-03-30 05:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14593153-fc07-5f81-a12d-88be6b943444, identifier: RE63795
2026-03-30 05:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14593153-fc07-5f81-a12d-88be6b943444 with identifier: RE63795
2026-03-30 05:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14593153-fc07-5f81-a12d-88be6b943444 with identifier: RE63795
2026-03-30 05:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14593153-fc07-5f81-a12d-88be6b943444 with identifier: RE63795 to the API
2026-03-30 05:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:17Z',
 'fuel_type': 'diesel',
 'id': '14593153-fc07-5f81-a12d-88be6b943444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE63795',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 213927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2011}
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Saving data for RE63795: {'auction_closing_time': 1774884977.0, 'created_time': 1774349926.889269, 'last_price_update_time': 1774848856.144001}
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE63795') HTTP/1.1" 204 0
2026-03-30 05:34:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for HU57590: 2
2026-03-30 05:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with identifier: HU57590
2026-03-30 05:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with scrape type 2
2026-03-30 05:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with scrape type 2
2026-03-30 05:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0, identifier: HU57590
2026-03-30 05:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with identifier: HU57590
2026-03-30 05:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with identifier: HU57590
2026-03-30 05:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0 with identifier: HU57590 to the API
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:03:55Z',
 'fuel_type': 'petrol',
 'id': 'abf3b5da-63cd-52b3-b5a0-8db09fe6b4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU57590',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 173423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-12',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 FSI Champ',
 'transmission': 'manual',
 'trim': 'Champ',
 'year': 2002}
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Saving data for HU57590: {'auction_closing_time': 1774883035.0, 'created_time': 1774638461.331825, 'last_price_update_time': 1774848856.665444}
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU57590') HTTP/1.1" 204 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for PD00543: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for HB06049: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for VL06718: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for LJ93781: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-30 05:34:16 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-30 05:34:16 [auto1.de] INFO: Scrape type for UR77035: 2
2026-03-30 05:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with identifier: UR77035
2026-03-30 05:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with scrape type 2
2026-03-30 05:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with scrape type 2
2026-03-30 05:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c85dc3fb-305b-5838-9726-e9d0bc9ccb17, identifier: UR77035
2026-03-30 05:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with identifier: UR77035
2026-03-30 05:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with identifier: UR77035
2026-03-30 05:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c85dc3fb-305b-5838-9726-e9d0bc9ccb17 with identifier: UR77035 to the API
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:39:44Z',
 'fuel_type': 'petrol',
 'id': 'c85dc3fb-305b-5838-9726-e9d0bc9ccb17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR77035',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 59763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Saving data for UR77035: {'auction_closing_time': 1774885184.0, 'created_time': 1774637154.906626, 'last_price_update_time': 1774848857.210517}
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR77035') HTTP/1.1" 204 0
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Scrape type for YN95759: 2
2026-03-30 05:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cd6bf6-4638-5804-9a01-435eec3c3278 with identifier: YN95759
2026-03-30 05:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cd6bf6-4638-5804-9a01-435eec3c3278 with scrape type 2
2026-03-30 05:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4cd6bf6-4638-5804-9a01-435eec3c3278 with scrape type 2
2026-03-30 05:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4cd6bf6-4638-5804-9a01-435eec3c3278, identifier: YN95759
2026-03-30 05:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4cd6bf6-4638-5804-9a01-435eec3c3278 with identifier: YN95759
2026-03-30 05:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4cd6bf6-4638-5804-9a01-435eec3c3278 with identifier: YN95759
2026-03-30 05:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4cd6bf6-4638-5804-9a01-435eec3c3278 with identifier: YN95759 to the API
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:52:03Z',
 'fuel_type': 'diesel',
 'id': 'e4cd6bf6-4638-5804-9a01-435eec3c3278',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN95759',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Saving data for YN95759: {'auction_closing_time': 1774885923.0, 'created_time': 1774549869.099702, 'last_price_update_time': 1774848857.744}
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN95759') HTTP/1.1" 204 0
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-30 05:34:17 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-30 05:34:17 [auto1.de] INFO: Scrape type for VG14564: 2
2026-03-30 05:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with identifier: VG14564
2026-03-30 05:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with scrape type 2
2026-03-30 05:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with scrape type 2
2026-03-30 05:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc, identifier: VG14564
2026-03-30 05:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with identifier: VG14564
2026-03-30 05:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with identifier: VG14564
2026-03-30 05:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f73a1a49-e8ed-5358-8e20-a7b4ef063ecc with identifier: VG14564 to the API
2026-03-30 05:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:15Z',
 'fuel_type': 'petrol',
 'id': 'f73a1a49-e8ed-5358-8e20-a7b4ef063ecc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG14564',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 157348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-30 05:34:18 [auto1.de] INFO: Saving data for VG14564: {'auction_closing_time': 1774883175.0, 'created_time': 1774521829.88498, 'last_price_update_time': 1774848858.168477}
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG14564') HTTP/1.1" 204 0
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-30 05:34:18 [auto1.de] INFO: Scrape type for HB13325: 2
2026-03-30 05:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with identifier: HB13325
2026-03-30 05:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with scrape type 2
2026-03-30 05:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with scrape type 2
2026-03-30 05:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b614f43-8a68-5bf9-bc28-f351c1270cf8, identifier: HB13325
2026-03-30 05:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with identifier: HB13325
2026-03-30 05:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with identifier: HB13325
2026-03-30 05:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b614f43-8a68-5bf9-bc28-f351c1270cf8 with identifier: HB13325 to the API
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': '9b614f43-8a68-5bf9-bc28-f351c1270cf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB13325',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 216862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2010}
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-30 05:34:18 [auto1.de] INFO: Saving data for HB13325: {'auction_closing_time': 1774884351.0, 'created_time': 1774639444.199552, 'last_price_update_time': 1774848858.653355}
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB13325') HTTP/1.1" 204 0
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-30 05:34:18 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-30 05:34:18 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-30 05:34:18 [auto1.de] INFO: Scrape type for FU04810: 2
2026-03-30 05:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8f1c4de-eabc-5ab9-b04f-bcad028e748f with identifier: FU04810
2026-03-30 05:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8f1c4de-eabc-5ab9-b04f-bcad028e748f with scrape type 2
2026-03-30 05:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8f1c4de-eabc-5ab9-b04f-bcad028e748f with scrape type 2
2026-03-30 05:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8f1c4de-eabc-5ab9-b04f-bcad028e748f, identifier: FU04810
2026-03-30 05:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8f1c4de-eabc-5ab9-b04f-bcad028e748f with identifier: FU04810
2026-03-30 05:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8f1c4de-eabc-5ab9-b04f-bcad028e748f with identifier: FU04810
2026-03-30 05:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8f1c4de-eabc-5ab9-b04f-bcad028e748f with identifier: FU04810 to the API
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-30T15:55:49Z',
 'fuel_type': 'petrol',
 'id': 'b8f1c4de-eabc-5ab9-b04f-bcad028e748f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU04810',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 50359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 45 Shooting Brake AMG S 4Matic',
 'transmission': 'automatic',
 'trim': 'S 4Matic',
 'year': 2022}
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Saving data for FU04810: {'auction_closing_time': 1774886149.0, 'created_time': 1774031964.139158, 'last_price_update_time': 1774848859.07526}
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU04810') HTTP/1.1" 204 0
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-30 05:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:19 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Scrape type for SB60272: 0
2026-03-30 05:34:19 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Scrape type for FG07323: 2
2026-03-30 05:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8dfdffd-e676-580a-9870-dc627a3c6612 with identifier: FG07323
2026-03-30 05:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8dfdffd-e676-580a-9870-dc627a3c6612 with scrape type 2
2026-03-30 05:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8dfdffd-e676-580a-9870-dc627a3c6612 with scrape type 2
2026-03-30 05:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8dfdffd-e676-580a-9870-dc627a3c6612, identifier: FG07323
2026-03-30 05:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8dfdffd-e676-580a-9870-dc627a3c6612 with identifier: FG07323
2026-03-30 05:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8dfdffd-e676-580a-9870-dc627a3c6612 with identifier: FG07323
2026-03-30 05:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8dfdffd-e676-580a-9870-dc627a3c6612 with identifier: FG07323 to the API
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:19Z',
 'fuel_type': 'petrol',
 'id': 'e8dfdffd-e676-580a-9870-dc627a3c6612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG07323',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 186101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-03',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-30 05:34:19 [auto1.de] INFO: Saving data for FG07323: {'auction_closing_time': 1774882999.0, 'created_time': 1774032714.090868, 'last_price_update_time': 1774848859.920953}
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG07323') HTTP/1.1" 204 0
2026-03-30 05:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for RZ48384: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for GA42145: 2
2026-03-30 05:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with identifier: GA42145
2026-03-30 05:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with scrape type 2
2026-03-30 05:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with scrape type 2
2026-03-30 05:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2, identifier: GA42145
2026-03-30 05:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with identifier: GA42145
2026-03-30 05:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with identifier: GA42145
2026-03-30 05:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2 with identifier: GA42145 to the API
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:26:49Z',
 'fuel_type': 'petrol',
 'id': '2b5dcdcb-1133-5fb3-8c43-aba1731e4bf2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA42145',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 190137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Saving data for GA42145: {'auction_closing_time': 1774884409.0, 'created_time': 1774521794.411978, 'last_price_update_time': 1774848860.461102}
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA42145') HTTP/1.1" 204 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for XY68410: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for TN32015: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for DA23811: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for TD17986: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for XS38036: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for DT00101: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-30 05:34:20 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-30 05:34:20 [auto1.de] INFO: Scrape type for CR26855: 2
2026-03-30 05:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with identifier: CR26855
2026-03-30 05:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with scrape type 2
2026-03-30 05:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with scrape type 2
2026-03-30 05:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16fea20f-0eb8-5acb-9521-af7f1cd6fd00, identifier: CR26855
2026-03-30 05:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with identifier: CR26855
2026-03-30 05:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with identifier: CR26855
2026-03-30 05:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16fea20f-0eb8-5acb-9521-af7f1cd6fd00 with identifier: CR26855 to the API
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:05:26Z',
 'fuel_type': 'petrol',
 'id': '16fea20f-0eb8-5acb-9521-af7f1cd6fd00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR26855',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 73019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-27',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Easy Entry',
 'transmission': 'manual',
 'trim': 'Easy Entry',
 'year': 2010}
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Saving data for CR26855: {'auction_closing_time': 1774883126.0, 'created_time': 1774349761.396946, 'last_price_update_time': 1774848861.083309}
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR26855') HTTP/1.1" 204 0
2026-03-30 05:34:21 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-30 05:34:21 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Scrape type for VP02166: 2
2026-03-30 05:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with identifier: VP02166
2026-03-30 05:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with scrape type 2
2026-03-30 05:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with scrape type 2
2026-03-30 05:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d21765f-9516-55dd-a1a3-cf4ad997fb57, identifier: VP02166
2026-03-30 05:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with identifier: VP02166
2026-03-30 05:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with identifier: VP02166
2026-03-30 05:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d21765f-9516-55dd-a1a3-cf4ad997fb57 with identifier: VP02166 to the API
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:35:58Z',
 'fuel_type': 'petrol',
 'id': '1d21765f-9516-55dd-a1a3-cf4ad997fb57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP02166',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 226705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Saving data for VP02166: {'auction_closing_time': 1774884958.0, 'created_time': 1773132999.729739, 'last_price_update_time': 1774848861.594989}
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP02166') HTTP/1.1" 204 0
2026-03-30 05:34:21 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-30 05:34:21 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-30 05:34:21 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-30 05:34:21 [auto1.de] INFO: Scrape type for RS09713: 0
2026-03-30 05:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:23 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Scrape type for PJ17742: 2
2026-03-30 05:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-30 05:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with scrape type 2
2026-03-30 05:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with scrape type 2
2026-03-30 05:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b12165d9-7293-57eb-a68a-f2d7f0a75fc8, identifier: PJ17742
2026-03-30 05:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-30 05:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742
2026-03-30 05:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b12165d9-7293-57eb-a68a-f2d7f0a75fc8 with identifier: PJ17742 to the API
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:37:40Z',
 'fuel_type': 'diesel',
 'id': 'b12165d9-7293-57eb-a68a-f2d7f0a75fc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ17742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 84862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
 'transmission': 'automatic',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Saving data for PJ17742: {'auction_closing_time': 1774885060.0, 'created_time': 1774550349.250902, 'last_price_update_time': 1774848863.453623}
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ17742') HTTP/1.1" 204 0
2026-03-30 05:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Scrape type for RB89503: 2
2026-03-30 05:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with identifier: RB89503
2026-03-30 05:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with scrape type 2
2026-03-30 05:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with scrape type 2
2026-03-30 05:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031, identifier: RB89503
2026-03-30 05:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with identifier: RB89503
2026-03-30 05:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with identifier: RB89503
2026-03-30 05:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031 with identifier: RB89503 to the API
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:13Z',
 'fuel_type': 'diesel',
 'id': 'e4dbbd97-a92c-5a5f-a0d0-d0cc8ea27031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB89503',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 236655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-14',
 'seller_name': None,
 'title': 'MINI Clubman Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Saving data for RB89503: {'auction_closing_time': 1774883233.0, 'created_time': 1774549859.208747, 'last_price_update_time': 1774848863.878182}
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB89503') HTTP/1.1" 204 0
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-30 05:34:23 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-30 05:34:23 [auto1.de] INFO: Scrape type for HE35464: 2
2026-03-30 05:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-30 05:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 006eb929-2593-5e7c-9ab4-ea49ecf09784 with scrape type 2
2026-03-30 05:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 006eb929-2593-5e7c-9ab4-ea49ecf09784 with scrape type 2
2026-03-30 05:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 006eb929-2593-5e7c-9ab4-ea49ecf09784, identifier: HE35464
2026-03-30 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-30 05:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464
2026-03-30 05:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 006eb929-2593-5e7c-9ab4-ea49ecf09784 with identifier: HE35464 to the API
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:15:04Z',
 'fuel_type': 'diesel',
 'id': '006eb929-2593-5e7c-9ab4-ea49ecf09784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE35464',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '4007',
 'odometer': 260272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Peugeot 4007 2.2 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Saving data for HE35464: {'auction_closing_time': 1774883704.0, 'created_time': 1774552695.447688, 'last_price_update_time': 1774848864.27612}
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE35464') HTTP/1.1" 204 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for JN99222: 2
2026-03-30 05:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with identifier: JN99222
2026-03-30 05:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with scrape type 2
2026-03-30 05:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with scrape type 2
2026-03-30 05:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7, identifier: JN99222
2026-03-30 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with identifier: JN99222
2026-03-30 05:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with identifier: JN99222
2026-03-30 05:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f80a14f-b7b5-51f5-8bbe-bb55877b33a7 with identifier: JN99222 to the API
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:26Z',
 'fuel_type': 'diesel',
 'id': '6f80a14f-b7b5-51f5-8bbe-bb55877b33a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN99222',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 169514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI kompakt',
 'transmission': 'automatic',
 'trim': 'kompakt',
 'year': 2014}
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Saving data for JN99222: {'auction_closing_time': 1774883966.0, 'created_time': 1773917337.136788, 'last_price_update_time': 1774848864.756742}
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN99222') HTTP/1.1" 204 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for GH93549: 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for VK94352: 0
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-30 05:34:24 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-30 05:34:24 [auto1.de] INFO: Scrape type for YS81277: 2
2026-03-30 05:34:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45bffe2e-71a9-5119-aed7-f0731055b03c with identifier: YS81277
2026-03-30 05:34:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45bffe2e-71a9-5119-aed7-f0731055b03c with scrape type 2
2026-03-30 05:34:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45bffe2e-71a9-5119-aed7-f0731055b03c with scrape type 2
2026-03-30 05:34:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45bffe2e-71a9-5119-aed7-f0731055b03c, identifier: YS81277
2026-03-30 05:34:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45bffe2e-71a9-5119-aed7-f0731055b03c with identifier: YS81277
2026-03-30 05:34:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45bffe2e-71a9-5119-aed7-f0731055b03c with identifier: YS81277
2026-03-30 05:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45bffe2e-71a9-5119-aed7-f0731055b03c with identifier: YS81277 to the API
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:04:50Z',
 'fuel_type': 'diesel',
 'id': '45bffe2e-71a9-5119-aed7-f0731055b03c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS81277',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 193741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Saving data for YS81277: {'auction_closing_time': 1774883090.0, 'created_time': 1773660273.187246, 'last_price_update_time': 1774848865.246067}
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS81277') HTTP/1.1" 204 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for TG33672: 2
2026-03-30 05:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with identifier: TG33672
2026-03-30 05:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with scrape type 2
2026-03-30 05:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with scrape type 2
2026-03-30 05:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53, identifier: TG33672
2026-03-30 05:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with identifier: TG33672
2026-03-30 05:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with identifier: TG33672
2026-03-30 05:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ea36273-6f12-5b23-a4c7-a7b4f2dfad53 with identifier: TG33672 to the API
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:40:04Z',
 'fuel_type': 'petrol',
 'id': '2ea36273-6f12-5b23-a4c7-a7b4f2dfad53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG33672',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 20395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2020}
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Saving data for TG33672: {'auction_closing_time': 1774885204.0, 'created_time': 1774638555.578618, 'last_price_update_time': 1774848865.812804}
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG33672') HTTP/1.1" 204 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for GC11605: 0
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-30 05:34:25 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-30 05:34:25 [auto1.de] INFO: Scrape type for FW30112: 2
2026-03-30 05:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc13820b-a510-5c34-8ef6-92c190ba3636 with identifier: FW30112
2026-03-30 05:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc13820b-a510-5c34-8ef6-92c190ba3636 with scrape type 2
2026-03-30 05:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc13820b-a510-5c34-8ef6-92c190ba3636 with scrape type 2
2026-03-30 05:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc13820b-a510-5c34-8ef6-92c190ba3636, identifier: FW30112
2026-03-30 05:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc13820b-a510-5c34-8ef6-92c190ba3636 with identifier: FW30112
2026-03-30 05:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc13820b-a510-5c34-8ef6-92c190ba3636 with identifier: FW30112
2026-03-30 05:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc13820b-a510-5c34-8ef6-92c190ba3636 with identifier: FW30112 to the API
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:33Z',
 'fuel_type': 'diesel',
 'id': 'fc13820b-a510-5c34-8ef6-92c190ba3636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW30112',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 179056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-18',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-30 05:34:26 [auto1.de] INFO: Saving data for FW30112: {'auction_closing_time': 1774883133.0, 'created_time': 1774637655.024511, 'last_price_update_time': 1774848866.350071}
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW30112') HTTP/1.1" 204 0
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-30 05:34:26 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-30 05:34:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:26 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-30 05:34:26 [auto1.de] INFO: Scrape type for HB72145: 2
2026-03-30 05:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with identifier: HB72145
2026-03-30 05:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with scrape type 2
2026-03-30 05:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with scrape type 2
2026-03-30 05:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8f269f3-e7be-5b16-a55f-41b67a5c4fe1, identifier: HB72145
2026-03-30 05:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with identifier: HB72145
2026-03-30 05:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with identifier: HB72145
2026-03-30 05:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8f269f3-e7be-5b16-a55f-41b67a5c4fe1 with identifier: HB72145 to the API
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:43:18Z',
 'fuel_type': 'petrol',
 'id': 'c8f269f3-e7be-5b16-a55f-41b67a5c4fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB72145',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 70858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Beats',
 'transmission': 'automatic',
 'trim': 'Beats',
 'year': 2018}
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-30 05:34:26 [auto1.de] INFO: Saving data for HB72145: {'auction_closing_time': 1774885398.0, 'created_time': 1774031474.370666, 'last_price_update_time': 1774848866.873106}
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB72145') HTTP/1.1" 204 0
2026-03-30 05:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-30 05:34:26 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-30 05:34:26 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Scrape type for RL23601: 2
2026-03-30 05:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aabae70-03cf-5ee8-bd07-da74171307ae with identifier: RL23601
2026-03-30 05:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aabae70-03cf-5ee8-bd07-da74171307ae with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aabae70-03cf-5ee8-bd07-da74171307ae with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aabae70-03cf-5ee8-bd07-da74171307ae, identifier: RL23601
2026-03-30 05:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aabae70-03cf-5ee8-bd07-da74171307ae with identifier: RL23601
2026-03-30 05:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aabae70-03cf-5ee8-bd07-da74171307ae with identifier: RL23601
2026-03-30 05:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aabae70-03cf-5ee8-bd07-da74171307ae with identifier: RL23601 to the API
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:50:40Z',
 'fuel_type': 'petrol',
 'id': '0aabae70-03cf-5ee8-bd07-da74171307ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL23601',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera Tino',
 'odometer': 145104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-26',
 'seller_name': None,
 'title': 'Nissan Almera Tino 1.8 Acenta plus',
 'transmission': 'manual',
 'trim': 'Acenta plus',
 'year': 2004}
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Saving data for RL23601: {'auction_closing_time': 1774885840.0, 'created_time': 1774549837.772743, 'last_price_update_time': 1774848867.366365}
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL23601') HTTP/1.1" 204 0
2026-03-30 05:34:27 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Scrape type for UL41666: 2
2026-03-30 05:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-30 05:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98bc471b-5c92-5567-9edc-a7703c627883 with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98bc471b-5c92-5567-9edc-a7703c627883 with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98bc471b-5c92-5567-9edc-a7703c627883, identifier: UL41666
2026-03-30 05:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-30 05:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666
2026-03-30 05:34:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98bc471b-5c92-5567-9edc-a7703c627883 with identifier: UL41666 to the API
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:37Z',
 'fuel_type': 'petrol',
 'id': '98bc471b-5c92-5567-9edc-a7703c627883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL41666',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Saving data for UL41666: {'auction_closing_time': 1774885117.0, 'created_time': 1774675836.55743, 'last_price_update_time': 1774848867.768853}
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL41666') HTTP/1.1" 204 0
2026-03-30 05:34:27 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-30 05:34:27 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-30 05:34:27 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-30 05:34:27 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-30 05:34:27 [auto1.de] INFO: Scrape type for UZ81937: 2
2026-03-30 05:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-30 05:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with scrape type 2
2026-03-30 05:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a, identifier: UZ81937
2026-03-30 05:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-30 05:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937
2026-03-30 05:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a with identifier: UZ81937 to the API
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:59:21Z',
 'fuel_type': 'hybrid',
 'id': 'e2eff24f-c84a-57a6-8c2e-6ed7fc7a1c6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ81937',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 53074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Saving data for UZ81937: {'auction_closing_time': 1774886361.0, 'created_time': 1774552354.984553, 'last_price_update_time': 1774848868.214427}
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ81937') HTTP/1.1" 204 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for DW36097: 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for UB34830: 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for YF48046: 2
2026-03-30 05:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with identifier: YF48046
2026-03-30 05:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with scrape type 2
2026-03-30 05:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with scrape type 2
2026-03-30 05:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e79d0c43-4fe2-5f47-81ed-dff3ea22f237, identifier: YF48046
2026-03-30 05:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with identifier: YF48046
2026-03-30 05:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with identifier: YF48046
2026-03-30 05:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e79d0c43-4fe2-5f47-81ed-dff3ea22f237 with identifier: YF48046 to the API
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:03Z',
 'fuel_type': 'diesel',
 'id': 'e79d0c43-4fe2-5f47-81ed-dff3ea22f237',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF48046',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 196704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-26',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer xDrive Luxury Line',
 'transmission': 'automatic',
 'trim': 'xDrive Luxury Line',
 'year': 2016}
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Saving data for YF48046: {'auction_closing_time': 1774885023.0, 'created_time': 1774636622.086944, 'last_price_update_time': 1774848868.662047}
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF48046') HTTP/1.1" 204 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-30 05:34:28 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-30 05:34:28 [auto1.de] INFO: Scrape type for KX26949: 2
2026-03-30 05:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-30 05:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with scrape type 2
2026-03-30 05:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with scrape type 2
2026-03-30 05:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d, identifier: KX26949
2026-03-30 05:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-30 05:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949
2026-03-30 05:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06bc3f6d-0e77-55b0-9739-99b67b2b4e0d with identifier: KX26949 to the API
2026-03-30 05:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:15Z',
 'fuel_type': 'diesel',
 'id': '06bc3f6d-0e77-55b0-9739-99b67b2b4e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX26949',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 168793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-10',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 M Trend LKW',
 'transmission': 'manual',
 'trim': 'FT 280 M Trend LKW',
 'year': 2011}
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Saving data for KX26949: {'auction_closing_time': 1774884975.0, 'created_time': 1774552930.450487, 'last_price_update_time': 1774848869.172832}
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX26949') HTTP/1.1" 204 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-30 05:34:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:29 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for UA36533: 0
2026-03-30 05:34:29 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Scrape type for CT74985: 2
2026-03-30 05:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with identifier: CT74985
2026-03-30 05:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with scrape type 2
2026-03-30 05:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with scrape type 2
2026-03-30 05:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0, identifier: CT74985
2026-03-30 05:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with identifier: CT74985
2026-03-30 05:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with identifier: CT74985
2026-03-30 05:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0 with identifier: CT74985 to the API
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:04:52Z',
 'fuel_type': 'petrol',
 'id': '62eb27cc-eb1b-50ea-ae5d-610d9ee60ba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT74985',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 147023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-23',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Enjoy',
 'transmission': 'automatic',
 'trim': 'Enjoy',
 'year': 2004}
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-30 05:34:29 [auto1.de] INFO: Saving data for CT74985: {'auction_closing_time': 1774883092.0, 'created_time': 1774639087.269383, 'last_price_update_time': 1774848869.989424}
2026-03-30 05:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT74985') HTTP/1.1" 204 0
2026-03-30 05:34:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Scrape type for SG56142: 2
2026-03-30 05:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with identifier: SG56142
2026-03-30 05:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with scrape type 2
2026-03-30 05:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with scrape type 2
2026-03-30 05:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c5f6d02-d129-5c93-ad55-00ebee4d7793, identifier: SG56142
2026-03-30 05:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with identifier: SG56142
2026-03-30 05:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with identifier: SG56142
2026-03-30 05:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c5f6d02-d129-5c93-ad55-00ebee4d7793 with identifier: SG56142 to the API
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:34:00Z',
 'fuel_type': 'petrol',
 'id': '7c5f6d02-d129-5c93-ad55-00ebee4d7793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG56142',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 56423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.5 TSI ACT Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Saving data for SG56142: {'auction_closing_time': 1774884840.0, 'created_time': 1774639061.258586, 'last_price_update_time': 1774848870.492314}
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG56142') HTTP/1.1" 204 0
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Scrape type for XN70423: 0
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Scrape type for TB82704: 2
2026-03-30 05:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9574fca7-1769-593f-b24d-e3514b62d79a with identifier: TB82704
2026-03-30 05:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9574fca7-1769-593f-b24d-e3514b62d79a with scrape type 2
2026-03-30 05:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9574fca7-1769-593f-b24d-e3514b62d79a with scrape type 2
2026-03-30 05:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9574fca7-1769-593f-b24d-e3514b62d79a, identifier: TB82704
2026-03-30 05:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9574fca7-1769-593f-b24d-e3514b62d79a with identifier: TB82704
2026-03-30 05:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9574fca7-1769-593f-b24d-e3514b62d79a with identifier: TB82704
2026-03-30 05:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9574fca7-1769-593f-b24d-e3514b62d79a with identifier: TB82704 to the API
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:17:38Z',
 'fuel_type': 'petrol',
 'id': '9574fca7-1769-593f-b24d-e3514b62d79a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB82704',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 165784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-10',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Saving data for TB82704: {'auction_closing_time': 1774883858.0, 'created_time': 1772728619.713036, 'last_price_update_time': 1774848870.938335}
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB82704') HTTP/1.1" 204 0
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-30 05:34:30 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-30 05:34:30 [auto1.de] INFO: Scrape type for VG55778: 2
2026-03-30 05:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd57617d-2d73-512b-a464-0d60f256f6b1 with identifier: VG55778
2026-03-30 05:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd57617d-2d73-512b-a464-0d60f256f6b1 with scrape type 2
2026-03-30 05:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd57617d-2d73-512b-a464-0d60f256f6b1 with scrape type 2
2026-03-30 05:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd57617d-2d73-512b-a464-0d60f256f6b1, identifier: VG55778
2026-03-30 05:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd57617d-2d73-512b-a464-0d60f256f6b1 with identifier: VG55778
2026-03-30 05:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd57617d-2d73-512b-a464-0d60f256f6b1 with identifier: VG55778
2026-03-30 05:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd57617d-2d73-512b-a464-0d60f256f6b1 with identifier: VG55778 to the API
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:02:54Z',
 'fuel_type': 'petrol',
 'id': 'fd57617d-2d73-512b-a464-0d60f256f6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG55778',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 203844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'BMW 4er 420i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-30 05:34:31 [auto1.de] INFO: Saving data for VG55778: {'auction_closing_time': 1774882974.0, 'created_time': 1774002240.408472, 'last_price_update_time': 1774848871.910135}
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG55778') HTTP/1.1" 204 0
2026-03-30 05:34:31 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-30 05:34:31 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-30 05:34:31 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-30 05:34:31 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-30 05:34:31 [auto1.de] INFO: Scrape type for AD73380: 2
2026-03-30 05:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 057d7576-39fe-5782-894c-4b9dc889f429 with identifier: AD73380
2026-03-30 05:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 057d7576-39fe-5782-894c-4b9dc889f429 with scrape type 2
2026-03-30 05:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 057d7576-39fe-5782-894c-4b9dc889f429 with scrape type 2
2026-03-30 05:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 057d7576-39fe-5782-894c-4b9dc889f429, identifier: AD73380
2026-03-30 05:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 057d7576-39fe-5782-894c-4b9dc889f429 with identifier: AD73380
2026-03-30 05:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 057d7576-39fe-5782-894c-4b9dc889f429 with identifier: AD73380
2026-03-30 05:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 057d7576-39fe-5782-894c-4b9dc889f429 with identifier: AD73380 to the API
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': '057d7576-39fe-5782-894c-4b9dc889f429',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD73380',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 118375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-19',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Attract",
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2013}
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Saving data for AD73380: {'auction_closing_time': 1774885441.0, 'created_time': 1774637928.028423, 'last_price_update_time': 1774848872.325235}
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD73380') HTTP/1.1" 204 0
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Scrape type for EJ57142: 2
2026-03-30 05:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62150aa8-07b6-5aab-b258-503fc4b25696 with identifier: EJ57142
2026-03-30 05:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62150aa8-07b6-5aab-b258-503fc4b25696 with scrape type 2
2026-03-30 05:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62150aa8-07b6-5aab-b258-503fc4b25696 with scrape type 2
2026-03-30 05:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62150aa8-07b6-5aab-b258-503fc4b25696, identifier: EJ57142
2026-03-30 05:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62150aa8-07b6-5aab-b258-503fc4b25696 with identifier: EJ57142
2026-03-30 05:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62150aa8-07b6-5aab-b258-503fc4b25696 with identifier: EJ57142
2026-03-30 05:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62150aa8-07b6-5aab-b258-503fc4b25696 with identifier: EJ57142 to the API
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:58:06Z',
 'fuel_type': 'diesel',
 'id': '62150aa8-07b6-5aab-b258-503fc4b25696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ57142',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 180110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2017}
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Saving data for EJ57142: {'auction_closing_time': 1774886286.0, 'created_time': 1774032601.119959, 'last_price_update_time': 1774848872.81436}
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ57142') HTTP/1.1" 204 0
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-30 05:34:32 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-30 05:34:32 [auto1.de] INFO: Scrape type for ZC19539: 2
2026-03-30 05:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09aab71d-a824-5765-930d-aee32cb46b0b with identifier: ZC19539
2026-03-30 05:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09aab71d-a824-5765-930d-aee32cb46b0b with scrape type 2
2026-03-30 05:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09aab71d-a824-5765-930d-aee32cb46b0b with scrape type 2
2026-03-30 05:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09aab71d-a824-5765-930d-aee32cb46b0b, identifier: ZC19539
2026-03-30 05:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09aab71d-a824-5765-930d-aee32cb46b0b with identifier: ZC19539
2026-03-30 05:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09aab71d-a824-5765-930d-aee32cb46b0b with identifier: ZC19539
2026-03-30 05:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09aab71d-a824-5765-930d-aee32cb46b0b with identifier: ZC19539 to the API
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:49:35Z',
 'fuel_type': 'petrol',
 'id': '09aab71d-a824-5765-930d-aee32cb46b0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC19539',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 85184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': None,
 'title': 'BMW 4er M440i Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Saving data for ZC19539: {'auction_closing_time': 1774885775.0, 'created_time': 1774550093.082886, 'last_price_update_time': 1774848873.297356}
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC19539') HTTP/1.1" 204 0
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Scrape type for FG50189: 0
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Scrape type for BU60385: 2
2026-03-30 05:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 062077d2-4414-5667-ae7a-6a65d42bab34 with identifier: BU60385
2026-03-30 05:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 062077d2-4414-5667-ae7a-6a65d42bab34 with scrape type 2
2026-03-30 05:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 062077d2-4414-5667-ae7a-6a65d42bab34 with scrape type 2
2026-03-30 05:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 062077d2-4414-5667-ae7a-6a65d42bab34, identifier: BU60385
2026-03-30 05:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 062077d2-4414-5667-ae7a-6a65d42bab34 with identifier: BU60385
2026-03-30 05:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 062077d2-4414-5667-ae7a-6a65d42bab34 with identifier: BU60385
2026-03-30 05:34:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 062077d2-4414-5667-ae7a-6a65d42bab34 with identifier: BU60385 to the API
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:23:29Z',
 'fuel_type': 'petrol',
 'id': '062077d2-4414-5667-ae7a-6a65d42bab34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU60385',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 106673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Saving data for BU60385: {'auction_closing_time': 1774884209.0, 'created_time': 1774637229.079744, 'last_price_update_time': 1774848873.76713}
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU60385') HTTP/1.1" 204 0
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-30 05:34:33 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-30 05:34:33 [auto1.de] INFO: Scrape type for MK35059: 2
2026-03-30 05:34:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with identifier: MK35059
2026-03-30 05:34:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with scrape type 2
2026-03-30 05:34:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with scrape type 2
2026-03-30 05:34:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e63fb2e-608e-5d38-804a-4ce4e2d39a84, identifier: MK35059
2026-03-30 05:34:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with identifier: MK35059
2026-03-30 05:34:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with identifier: MK35059
2026-03-30 05:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e63fb2e-608e-5d38-804a-4ce4e2d39a84 with identifier: MK35059 to the API
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'petrol',
 'id': '2e63fb2e-608e-5d38-804a-4ce4e2d39a84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK35059',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 144694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-05',
 'seller_name': None,
 'title': 'Seat Altea 1.6 Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2005}
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-30 05:34:34 [auto1.de] INFO: Saving data for MK35059: {'auction_closing_time': 1774885731.0, 'created_time': 1773224835.264227, 'last_price_update_time': 1774848874.224697}
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK35059') HTTP/1.1" 204 0
2026-03-30 05:34:34 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-30 05:34:34 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-30 05:34:34 [auto1.de] INFO: Scrape type for VM51620: 2
2026-03-30 05:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8df26ac-dbc7-5535-af46-3e7a953d60b2 with identifier: VM51620
2026-03-30 05:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8df26ac-dbc7-5535-af46-3e7a953d60b2 with scrape type 2
2026-03-30 05:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8df26ac-dbc7-5535-af46-3e7a953d60b2 with scrape type 2
2026-03-30 05:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8df26ac-dbc7-5535-af46-3e7a953d60b2, identifier: VM51620
2026-03-30 05:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8df26ac-dbc7-5535-af46-3e7a953d60b2 with identifier: VM51620
2026-03-30 05:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8df26ac-dbc7-5535-af46-3e7a953d60b2 with identifier: VM51620
2026-03-30 05:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8df26ac-dbc7-5535-af46-3e7a953d60b2 with identifier: VM51620 to the API
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': 'd8df26ac-dbc7-5535-af46-3e7a953d60b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM51620',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 134330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-15',
 'seller_name': None,
 'title': 'BMW X4 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-30 05:34:34 [auto1.de] INFO: Saving data for VM51620: {'auction_closing_time': 1774883776.0, 'created_time': 1774639220.350635, 'last_price_update_time': 1774848874.656453}
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM51620') HTTP/1.1" 204 0
2026-03-30 05:34:34 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-30 05:34:34 [auto1.de] INFO: Scrape type for PY88606: 2
2026-03-30 05:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with identifier: PY88606
2026-03-30 05:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with scrape type 2
2026-03-30 05:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with scrape type 2
2026-03-30 05:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad, identifier: PY88606
2026-03-30 05:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with identifier: PY88606
2026-03-30 05:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with identifier: PY88606
2026-03-30 05:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad with identifier: PY88606 to the API
2026-03-30 05:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:50Z',
 'fuel_type': 'diesel',
 'id': '2da571ee-a5a2-5dcc-be0e-f6c4e7af50ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY88606',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 262792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2016}
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Saving data for PY88606: {'auction_closing_time': 1774885610.0, 'created_time': 1773225814.318998, 'last_price_update_time': 1774848875.17525}
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY88606') HTTP/1.1" 204 0
2026-03-30 05:34:35 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for TX40951: 2
2026-03-30 05:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with identifier: TX40951
2026-03-30 05:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8a07f1f-51ed-5573-b184-6d2f86cf1b55, identifier: TX40951
2026-03-30 05:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with identifier: TX40951
2026-03-30 05:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with identifier: TX40951
2026-03-30 05:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8a07f1f-51ed-5573-b184-6d2f86cf1b55 with identifier: TX40951 to the API
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:38Z',
 'fuel_type': 'diesel',
 'id': 'f8a07f1f-51ed-5573-b184-6d2f86cf1b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40951',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 195445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Saving data for TX40951: {'auction_closing_time': 1774883258.0, 'created_time': 1773945683.891419, 'last_price_update_time': 1774848875.62615}
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40951') HTTP/1.1" 204 0
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for LA66980: 0
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for TM25044: 2
2026-03-30 05:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 955182b8-4c1c-57c1-af13-06c85cf9cd21 with identifier: TM25044
2026-03-30 05:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 955182b8-4c1c-57c1-af13-06c85cf9cd21 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 955182b8-4c1c-57c1-af13-06c85cf9cd21 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 955182b8-4c1c-57c1-af13-06c85cf9cd21, identifier: TM25044
2026-03-30 05:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:35 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-30 05:34:35 [auto1.de] INFO: Scrape type for BU16541: 2
2026-03-30 05:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5df64c10-db7b-5c6b-ad29-ef521b438370 with identifier: BU16541
2026-03-30 05:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5df64c10-db7b-5c6b-ad29-ef521b438370 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5df64c10-db7b-5c6b-ad29-ef521b438370 with scrape type 2
2026-03-30 05:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5df64c10-db7b-5c6b-ad29-ef521b438370, identifier: BU16541
2026-03-30 05:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 955182b8-4c1c-57c1-af13-06c85cf9cd21 with identifier: TM25044
2026-03-30 05:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 955182b8-4c1c-57c1-af13-06c85cf9cd21 with identifier: TM25044
2026-03-30 05:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 955182b8-4c1c-57c1-af13-06c85cf9cd21 with identifier: TM25044 to the API
2026-03-30 05:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:29:48Z',
 'fuel_type': 'diesel',
 'id': '955182b8-4c1c-57c1-af13-06c85cf9cd21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM25044',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 102054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-30 05:34:36 [auto1.de] INFO: Saving data for TM25044: {'auction_closing_time': 1774884588.0, 'created_time': 1774032264.922922, 'last_price_update_time': 1774848876.179888}
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM25044') HTTP/1.1" 204 0
2026-03-30 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5df64c10-db7b-5c6b-ad29-ef521b438370 with identifier: BU16541
2026-03-30 05:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5df64c10-db7b-5c6b-ad29-ef521b438370 with identifier: BU16541
2026-03-30 05:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5df64c10-db7b-5c6b-ad29-ef521b438370 with identifier: BU16541 to the API
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:55Z',
 'fuel_type': 'diesel',
 'id': '5df64c10-db7b-5c6b-ad29-ef521b438370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16541',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 253326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-30 05:34:36 [auto1.de] INFO: Saving data for BU16541: {'auction_closing_time': 1774886395.0, 'created_time': 1774639064.239887, 'last_price_update_time': 1774848876.476624}
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU16541') HTTP/1.1" 204 0
2026-03-30 05:34:36 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-30 05:34:36 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-30 05:34:36 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 05:34:36 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-30 05:34:36 [auto1.de] INFO: Scrape type for ZW55395: 2
2026-03-30 05:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with identifier: ZW55395
2026-03-30 05:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with scrape type 2
2026-03-30 05:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with scrape type 2
2026-03-30 05:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57, identifier: ZW55395
2026-03-30 05:34:36 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-30 05:34:36 [auto1.de] INFO: Scrape type for EA67695: 2
2026-03-30 05:34:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d04c7780-b98b-5442-a473-afbb3375d47b with identifier: EA67695
2026-03-30 05:34:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d04c7780-b98b-5442-a473-afbb3375d47b with scrape type 2
2026-03-30 05:34:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d04c7780-b98b-5442-a473-afbb3375d47b with scrape type 2
2026-03-30 05:34:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d04c7780-b98b-5442-a473-afbb3375d47b, identifier: EA67695
2026-03-30 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with identifier: ZW55395
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 05:34:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:34:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with identifier: ZW55395
2026-03-30 05:34:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57 with identifier: ZW55395 to the API
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:24:18Z',
 'fuel_type': 'petrol',
 'id': 'dfbc2cb0-a3e6-5f60-9afb-0f27921e3e57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW55395',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 103330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Saving data for ZW55395: {'auction_closing_time': 1774884258.0, 'created_time': 1774636606.841619, 'last_price_update_time': 1774848877.067587}
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW55395') HTTP/1.1" 204 0
2026-03-30 05:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d04c7780-b98b-5442-a473-afbb3375d47b with identifier: EA67695
2026-03-30 05:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d04c7780-b98b-5442-a473-afbb3375d47b with identifier: EA67695
2026-03-30 05:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d04c7780-b98b-5442-a473-afbb3375d47b with identifier: EA67695 to the API
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:30Z',
 'fuel_type': 'petrol',
 'id': 'd04c7780-b98b-5442-a473-afbb3375d47b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA67695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 159209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Saving data for EA67695: {'auction_closing_time': 1774884090.0, 'created_time': 1774550441.925924, 'last_price_update_time': 1774848877.455347}
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA67695') HTTP/1.1" 204 0
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Scrape type for LV04533: 2
2026-03-30 05:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2400d4b-7afb-5e57-b05e-8042d2e448bd with identifier: LV04533
2026-03-30 05:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2400d4b-7afb-5e57-b05e-8042d2e448bd with scrape type 2
2026-03-30 05:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2400d4b-7afb-5e57-b05e-8042d2e448bd with scrape type 2
2026-03-30 05:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2400d4b-7afb-5e57-b05e-8042d2e448bd, identifier: LV04533
2026-03-30 05:34:37 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-30 05:34:37 [auto1.de] INFO: Scrape type for GP15297: 2
2026-03-30 05:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 733e49c3-5bb8-54a5-be39-70a39ae60af9 with identifier: GP15297
2026-03-30 05:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 733e49c3-5bb8-54a5-be39-70a39ae60af9 with scrape type 2
2026-03-30 05:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 733e49c3-5bb8-54a5-be39-70a39ae60af9 with scrape type 2
2026-03-30 05:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 733e49c3-5bb8-54a5-be39-70a39ae60af9, identifier: GP15297
2026-03-30 05:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2400d4b-7afb-5e57-b05e-8042d2e448bd with identifier: LV04533
2026-03-30 05:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2400d4b-7afb-5e57-b05e-8042d2e448bd with identifier: LV04533
2026-03-30 05:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2400d4b-7afb-5e57-b05e-8042d2e448bd with identifier: LV04533 to the API
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:14Z',
 'fuel_type': 'petrol',
 'id': 'a2400d4b-7afb-5e57-b05e-8042d2e448bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV04533',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 94258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-26',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2020}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Saving data for LV04533: {'auction_closing_time': 1774883594.0, 'created_time': 1774637954.662923, 'last_price_update_time': 1774848878.035938}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV04533') HTTP/1.1" 204 0
2026-03-30 05:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 733e49c3-5bb8-54a5-be39-70a39ae60af9 with identifier: GP15297
2026-03-30 05:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 733e49c3-5bb8-54a5-be39-70a39ae60af9 with identifier: GP15297
2026-03-30 05:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 733e49c3-5bb8-54a5-be39-70a39ae60af9 with identifier: GP15297 to the API
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:40:01Z',
 'fuel_type': 'diesel',
 'id': '733e49c3-5bb8-54a5-be39-70a39ae60af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP15297',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 523162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-13',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D5 Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2009}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Saving data for GP15297: {'auction_closing_time': 1774885201.0, 'created_time': 1773830283.946434, 'last_price_update_time': 1774848878.316651}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP15297') HTTP/1.1" 204 0
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for RY91957: 0
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for DX24804: 2
2026-03-30 05:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8e81939-1ab6-554c-bc65-1309c5fb4240 with identifier: DX24804
2026-03-30 05:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8e81939-1ab6-554c-bc65-1309c5fb4240 with scrape type 2
2026-03-30 05:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8e81939-1ab6-554c-bc65-1309c5fb4240 with scrape type 2
2026-03-30 05:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8e81939-1ab6-554c-bc65-1309c5fb4240, identifier: DX24804
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-30 05:34:38 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Scrape type for BG86685: 2
2026-03-30 05:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with identifier: BG86685
2026-03-30 05:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with scrape type 2
2026-03-30 05:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with scrape type 2
2026-03-30 05:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58be5c7f-6f34-5d4e-91cb-56c583e5b397, identifier: BG86685
2026-03-30 05:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8e81939-1ab6-554c-bc65-1309c5fb4240 with identifier: DX24804
2026-03-30 05:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8e81939-1ab6-554c-bc65-1309c5fb4240 with identifier: DX24804
2026-03-30 05:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8e81939-1ab6-554c-bc65-1309c5fb4240 with identifier: DX24804 to the API
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:39:13Z',
 'fuel_type': 'petrol',
 'id': 'a8e81939-1ab6-554c-bc65-1309c5fb4240',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX24804',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 118720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-03',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-30 05:34:38 [auto1.de] INFO: Saving data for DX24804: {'auction_closing_time': 1774885153.0, 'created_time': 1774636463.036053, 'last_price_update_time': 1774848878.933246}
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX24804') HTTP/1.1" 204 0
2026-03-30 05:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with identifier: BG86685
2026-03-30 05:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with identifier: BG86685
2026-03-30 05:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58be5c7f-6f34-5d4e-91cb-56c583e5b397 with identifier: BG86685 to the API
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:21:40Z',
 'fuel_type': 'petrol',
 'id': '58be5c7f-6f34-5d4e-91cb-56c583e5b397',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG86685',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 89699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-30 05:34:39 [auto1.de] INFO: Saving data for BG86685: {'auction_closing_time': 1774884100.0, 'created_time': 1774549890.557456, 'last_price_update_time': 1774848879.314648}
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG86685') HTTP/1.1" 204 0
2026-03-30 05:34:39 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-30 05:34:39 [auto1.de] INFO: Scrape type for KG08192: 2
2026-03-30 05:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-30 05:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63bb6853-1dcc-551c-8055-faeebc070221 with scrape type 2
2026-03-30 05:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63bb6853-1dcc-551c-8055-faeebc070221 with scrape type 2
2026-03-30 05:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63bb6853-1dcc-551c-8055-faeebc070221, identifier: KG08192
2026-03-30 05:34:39 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-30 05:34:39 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-30 05:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-30 05:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192
2026-03-30 05:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63bb6853-1dcc-551c-8055-faeebc070221 with identifier: KG08192 to the API
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:42:43Z',
 'fuel_type': 'petrol',
 'id': '63bb6853-1dcc-551c-8055-faeebc070221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG08192',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 57825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-10',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2007}
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-30 05:34:39 [auto1.de] INFO: Saving data for KG08192: {'auction_closing_time': 1774885363.0, 'created_time': 1774552779.14027, 'last_price_update_time': 1774848879.732541}
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG08192') HTTP/1.1" 204 0
2026-03-30 05:34:39 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-30 05:34:39 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-30 05:34:39 [auto1.de] INFO: Scrape type for GL07101: 2
2026-03-30 05:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 277a5383-ffa1-5362-a7d5-d6088d48cfdb with identifier: GL07101
2026-03-30 05:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 277a5383-ffa1-5362-a7d5-d6088d48cfdb with scrape type 2
2026-03-30 05:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 277a5383-ffa1-5362-a7d5-d6088d48cfdb with scrape type 2
2026-03-30 05:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 277a5383-ffa1-5362-a7d5-d6088d48cfdb, identifier: GL07101
2026-03-30 05:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 277a5383-ffa1-5362-a7d5-d6088d48cfdb with identifier: GL07101
2026-03-30 05:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 277a5383-ffa1-5362-a7d5-d6088d48cfdb with identifier: GL07101
2026-03-30 05:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 277a5383-ffa1-5362-a7d5-d6088d48cfdb with identifier: GL07101 to the API
2026-03-30 05:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:16:15Z',
 'fuel_type': 'diesel',
 'id': '277a5383-ffa1-5362-a7d5-d6088d48cfdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL07101',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 163282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Saving data for GL07101: {'auction_closing_time': 1774883775.0, 'created_time': 1773830568.088078, 'last_price_update_time': 1774848880.152091}
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL07101') HTTP/1.1" 204 0
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Scrape type for TE32041: 0
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Scrape type for YG72803: 2
2026-03-30 05:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5127786b-765d-5125-9bf7-dd6aef6b6e1a with identifier: YG72803
2026-03-30 05:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5127786b-765d-5125-9bf7-dd6aef6b6e1a with scrape type 2
2026-03-30 05:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5127786b-765d-5125-9bf7-dd6aef6b6e1a with scrape type 2
2026-03-30 05:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5127786b-765d-5125-9bf7-dd6aef6b6e1a, identifier: YG72803
2026-03-30 05:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5127786b-765d-5125-9bf7-dd6aef6b6e1a with identifier: YG72803
2026-03-30 05:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5127786b-765d-5125-9bf7-dd6aef6b6e1a with identifier: YG72803
2026-03-30 05:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5127786b-765d-5125-9bf7-dd6aef6b6e1a with identifier: YG72803 to the API
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:20Z',
 'fuel_type': 'diesel',
 'id': '5127786b-765d-5125-9bf7-dd6aef6b6e1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG72803',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 151955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-11',
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TDI BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Tech',
 'year': 2014}
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Saving data for YG72803: {'auction_closing_time': 1774886000.0, 'created_time': 1773916764.659746, 'last_price_update_time': 1774848880.587125}
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG72803') HTTP/1.1" 204 0
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-30 05:34:40 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 05:34:40 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 05:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:41 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:41 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 05:34:41 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-30 05:34:41 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-30 05:34:41 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 05:34:41 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-30 05:34:41 [auto1.de] INFO: Scrape type for CY90259: 0
2026-03-30 05:34:41 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-30 05:34:41 [auto1.de] INFO: Scrape type for BY14877: 2
2026-03-30 05:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109669f4-c3f4-5588-a5c2-169d178398b1 with identifier: BY14877
2026-03-30 05:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109669f4-c3f4-5588-a5c2-169d178398b1 with scrape type 2
2026-03-30 05:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109669f4-c3f4-5588-a5c2-169d178398b1 with scrape type 2
2026-03-30 05:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109669f4-c3f4-5588-a5c2-169d178398b1, identifier: BY14877
2026-03-30 05:34:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109669f4-c3f4-5588-a5c2-169d178398b1 with identifier: BY14877
2026-03-30 05:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109669f4-c3f4-5588-a5c2-169d178398b1 with identifier: BY14877
2026-03-30 05:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109669f4-c3f4-5588-a5c2-169d178398b1 with identifier: BY14877 to the API
2026-03-30 05:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'diesel',
 'id': '109669f4-c3f4-5588-a5c2-169d178398b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY14877',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 80334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Saving data for BY14877: {'auction_closing_time': 1774885196.0, 'created_time': 1774521916.527836, 'last_price_update_time': 1774848882.16446}
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY14877') HTTP/1.1" 204 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for AV93240: 2
2026-03-30 05:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2139f035-68ca-54d4-bc4d-b8ec6856494e with identifier: AV93240
2026-03-30 05:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2139f035-68ca-54d4-bc4d-b8ec6856494e with scrape type 2
2026-03-30 05:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2139f035-68ca-54d4-bc4d-b8ec6856494e with scrape type 2
2026-03-30 05:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2139f035-68ca-54d4-bc4d-b8ec6856494e, identifier: AV93240
2026-03-30 05:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2139f035-68ca-54d4-bc4d-b8ec6856494e with identifier: AV93240
2026-03-30 05:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2139f035-68ca-54d4-bc4d-b8ec6856494e with identifier: AV93240
2026-03-30 05:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2139f035-68ca-54d4-bc4d-b8ec6856494e with identifier: AV93240 to the API
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:12:49Z',
 'fuel_type': 'diesel',
 'id': '2139f035-68ca-54d4-bc4d-b8ec6856494e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV93240',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 371285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Saving data for AV93240: {'auction_closing_time': 1774883569.0, 'created_time': 1774637982.844162, 'last_price_update_time': 1774848882.569042}
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV93240') HTTP/1.1" 204 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for GC82813: 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-30 05:34:42 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-30 05:34:42 [auto1.de] INFO: Scrape type for GE28071: 2
2026-03-30 05:34:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40084062-73b4-54ff-b825-c40e56655939 with identifier: GE28071
2026-03-30 05:34:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40084062-73b4-54ff-b825-c40e56655939 with scrape type 2
2026-03-30 05:34:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40084062-73b4-54ff-b825-c40e56655939 with scrape type 2
2026-03-30 05:34:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40084062-73b4-54ff-b825-c40e56655939, identifier: GE28071
2026-03-30 05:34:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40084062-73b4-54ff-b825-c40e56655939 with identifier: GE28071
2026-03-30 05:34:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40084062-73b4-54ff-b825-c40e56655939 with identifier: GE28071
2026-03-30 05:34:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40084062-73b4-54ff-b825-c40e56655939 with identifier: GE28071 to the API
2026-03-30 05:34:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:55Z',
 'fuel_type': 'diesel',
 'id': '40084062-73b4-54ff-b825-c40e56655939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE28071',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 213135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-30 05:34:43 [auto1.de] INFO: Saving data for GE28071: {'auction_closing_time': 1774885555.0, 'created_time': 1774637223.573861, 'last_price_update_time': 1774848883.134061}
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE28071') HTTP/1.1" 204 0
2026-03-30 05:34:43 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-30 05:34:43 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-30 05:34:43 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-30 05:34:43 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-30 05:34:43 [auto1.de] INFO: Scrape type for FX62858: 2
2026-03-30 05:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3b04221-878d-5633-8603-07aaad106a6f with identifier: FX62858
2026-03-30 05:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3b04221-878d-5633-8603-07aaad106a6f with scrape type 2
2026-03-30 05:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3b04221-878d-5633-8603-07aaad106a6f with scrape type 2
2026-03-30 05:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3b04221-878d-5633-8603-07aaad106a6f, identifier: FX62858
2026-03-30 05:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3b04221-878d-5633-8603-07aaad106a6f with identifier: FX62858
2026-03-30 05:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3b04221-878d-5633-8603-07aaad106a6f with identifier: FX62858
2026-03-30 05:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3b04221-878d-5633-8603-07aaad106a6f with identifier: FX62858 to the API
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:27Z',
 'fuel_type': 'petrol',
 'id': 'd3b04221-878d-5633-8603-07aaad106a6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX62858',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 134169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Sync Edition',
 'transmission': 'manual',
 'trim': 'Sync Edition',
 'year': 2015}
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-30 05:34:43 [auto1.de] INFO: Saving data for FX62858: {'auction_closing_time': 1774884627.0, 'created_time': 1774636461.271686, 'last_price_update_time': 1774848883.578636}
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX62858') HTTP/1.1" 204 0
2026-03-30 05:34:43 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-30 05:34:43 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-30 05:34:43 [auto1.de] INFO: Scrape type for CF74386: 2
2026-03-30 05:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d003adf9-ad73-596c-8c06-bd5840108755 with identifier: CF74386
2026-03-30 05:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d003adf9-ad73-596c-8c06-bd5840108755 with scrape type 2
2026-03-30 05:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d003adf9-ad73-596c-8c06-bd5840108755 with scrape type 2
2026-03-30 05:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d003adf9-ad73-596c-8c06-bd5840108755, identifier: CF74386
2026-03-30 05:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d003adf9-ad73-596c-8c06-bd5840108755 with identifier: CF74386
2026-03-30 05:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d003adf9-ad73-596c-8c06-bd5840108755 with identifier: CF74386
2026-03-30 05:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d003adf9-ad73-596c-8c06-bd5840108755 with identifier: CF74386 to the API
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:43Z',
 'fuel_type': 'petrol',
 'id': 'd003adf9-ad73-596c-8c06-bd5840108755',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF74386',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 227933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-01',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Saving data for CF74386: {'auction_closing_time': 1774886323.0, 'created_time': 1774636482.117618, 'last_price_update_time': 1774848884.084032}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF74386') HTTP/1.1" 204 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for CG17958: 2
2026-03-30 05:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with identifier: CG17958
2026-03-30 05:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with scrape type 2
2026-03-30 05:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with scrape type 2
2026-03-30 05:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b, identifier: CG17958
2026-03-30 05:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with identifier: CG17958
2026-03-30 05:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with identifier: CG17958
2026-03-30 05:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6aaa33d4-61e9-5f5d-b605-f349c8c6e14b with identifier: CG17958 to the API
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:08:07Z',
 'fuel_type': 'diesel',
 'id': '6aaa33d4-61e9-5f5d-b605-f349c8c6e14b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG17958',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 201465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Saving data for CG17958: {'auction_closing_time': 1774883287.0, 'created_time': 1774637283.872124, 'last_price_update_time': 1774848884.532567}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG17958') HTTP/1.1" 204 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-30 05:34:44 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Scrape type for GJ72052: 2
2026-03-30 05:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with identifier: GJ72052
2026-03-30 05:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with scrape type 2
2026-03-30 05:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with scrape type 2
2026-03-30 05:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 582e756f-8a58-5e7d-b02b-dcf1c3593c4f, identifier: GJ72052
2026-03-30 05:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with identifier: GJ72052
2026-03-30 05:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with identifier: GJ72052
2026-03-30 05:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 582e756f-8a58-5e7d-b02b-dcf1c3593c4f with identifier: GJ72052 to the API
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:32:42Z',
 'fuel_type': 'petrol',
 'id': '582e756f-8a58-5e7d-b02b-dcf1c3593c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ72052',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 105600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-16',
 'seller_name': None,
 'title': 'MINI Roadster Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-30 05:34:44 [auto1.de] INFO: Saving data for GJ72052: {'auction_closing_time': 1774884762.0, 'created_time': 1773303605.5343, 'last_price_update_time': 1774848884.97214}
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ72052') HTTP/1.1" 204 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for UT25770: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for KE90255: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for YD46257: 0
2026-03-30 05:34:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:45 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for RP89370: 2
2026-03-30 05:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2ee2df-62b5-5997-a018-81535a05bd2f with identifier: RP89370
2026-03-30 05:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2ee2df-62b5-5997-a018-81535a05bd2f with scrape type 2
2026-03-30 05:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2ee2df-62b5-5997-a018-81535a05bd2f with scrape type 2
2026-03-30 05:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a2ee2df-62b5-5997-a018-81535a05bd2f, identifier: RP89370
2026-03-30 05:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a2ee2df-62b5-5997-a018-81535a05bd2f with identifier: RP89370
2026-03-30 05:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a2ee2df-62b5-5997-a018-81535a05bd2f with identifier: RP89370
2026-03-30 05:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a2ee2df-62b5-5997-a018-81535a05bd2f with identifier: RP89370 to the API
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:43Z',
 'fuel_type': 'diesel',
 'id': '7a2ee2df-62b5-5997-a018-81535a05bd2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP89370',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 215178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Joy 4x4',
 'transmission': 'automatic',
 'trim': 'Joy 4x4',
 'year': 2016}
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Saving data for RP89370: {'auction_closing_time': 1774883803.0, 'created_time': 1774636703.861827, 'last_price_update_time': 1774848885.699935}
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP89370') HTTP/1.1" 204 0
2026-03-30 05:34:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-30 05:34:45 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-30 05:34:45 [auto1.de] INFO: Scrape type for FX76120: 2
2026-03-30 05:34:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with identifier: FX76120
2026-03-30 05:34:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with scrape type 2
2026-03-30 05:34:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with scrape type 2
2026-03-30 05:34:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b4b0e7f-4479-5922-8c73-5d661fb2ac72, identifier: FX76120
2026-03-30 05:34:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with identifier: FX76120
2026-03-30 05:34:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with identifier: FX76120
2026-03-30 05:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b4b0e7f-4479-5922-8c73-5d661fb2ac72 with identifier: FX76120 to the API
2026-03-30 05:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:46:23Z',
 'fuel_type': 'diesel',
 'id': '7b4b0e7f-4479-5922-8c73-5d661fb2ac72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX76120',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 46840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Active',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Active',
 'year': 2022}
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-30 05:34:46 [auto1.de] INFO: Saving data for FX76120: {'auction_closing_time': 1774885583.0, 'created_time': 1773303433.90236, 'last_price_update_time': 1774848886.195126}
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX76120') HTTP/1.1" 204 0
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-30 05:34:46 [auto1.de] INFO: Scrape type for DB28845: 2
2026-03-30 05:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badffa9d-8d14-53f1-8b65-55b5e9d53e22 with identifier: DB28845
2026-03-30 05:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badffa9d-8d14-53f1-8b65-55b5e9d53e22 with scrape type 2
2026-03-30 05:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item badffa9d-8d14-53f1-8b65-55b5e9d53e22 with scrape type 2
2026-03-30 05:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badffa9d-8d14-53f1-8b65-55b5e9d53e22, identifier: DB28845
2026-03-30 05:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badffa9d-8d14-53f1-8b65-55b5e9d53e22 with identifier: DB28845
2026-03-30 05:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badffa9d-8d14-53f1-8b65-55b5e9d53e22 with identifier: DB28845
2026-03-30 05:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badffa9d-8d14-53f1-8b65-55b5e9d53e22 with identifier: DB28845 to the API
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:16:03Z',
 'fuel_type': 'diesel',
 'id': 'badffa9d-8d14-53f1-8b65-55b5e9d53e22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB28845',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 53515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2019}
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-30 05:34:46 [auto1.de] INFO: Saving data for DB28845: {'auction_closing_time': 1774883763.0, 'created_time': 1774639441.23206, 'last_price_update_time': 1774848886.592264}
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB28845') HTTP/1.1" 204 0
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-30 05:34:46 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-30 05:34:46 [auto1.de] INFO: Scrape type for VA07254: 2
2026-03-30 05:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6f97bc-0bde-5048-a873-61f114cb0f14 with identifier: VA07254
2026-03-30 05:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6f97bc-0bde-5048-a873-61f114cb0f14 with scrape type 2
2026-03-30 05:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6f97bc-0bde-5048-a873-61f114cb0f14 with scrape type 2
2026-03-30 05:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b6f97bc-0bde-5048-a873-61f114cb0f14, identifier: VA07254
2026-03-30 05:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b6f97bc-0bde-5048-a873-61f114cb0f14 with identifier: VA07254
2026-03-30 05:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b6f97bc-0bde-5048-a873-61f114cb0f14 with identifier: VA07254
2026-03-30 05:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b6f97bc-0bde-5048-a873-61f114cb0f14 with identifier: VA07254 to the API
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:21Z',
 'fuel_type': 'petrol',
 'id': '1b6f97bc-0bde-5048-a873-61f114cb0f14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA07254',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 38064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Saving data for VA07254: {'auction_closing_time': 1774883481.0, 'created_time': 1774639454.814182, 'last_price_update_time': 1774848887.076893}
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA07254') HTTP/1.1" 204 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for UF84610: 2
2026-03-30 05:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f065e1-d574-58cd-b576-3a7498c220a8 with identifier: UF84610
2026-03-30 05:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f065e1-d574-58cd-b576-3a7498c220a8 with scrape type 2
2026-03-30 05:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f065e1-d574-58cd-b576-3a7498c220a8 with scrape type 2
2026-03-30 05:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33f065e1-d574-58cd-b576-3a7498c220a8, identifier: UF84610
2026-03-30 05:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33f065e1-d574-58cd-b576-3a7498c220a8 with identifier: UF84610
2026-03-30 05:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33f065e1-d574-58cd-b576-3a7498c220a8 with identifier: UF84610
2026-03-30 05:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33f065e1-d574-58cd-b576-3a7498c220a8 with identifier: UF84610 to the API
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:04:58Z',
 'fuel_type': 'diesel',
 'id': '33f065e1-d574-58cd-b576-3a7498c220a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF84610',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Saving data for UF84610: {'auction_closing_time': 1774883098.0, 'created_time': 1774637416.664134, 'last_price_update_time': 1774848887.453331}
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF84610') HTTP/1.1" 204 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for NW39371: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for BY42207: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 05:34:47 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-30 05:34:47 [auto1.de] INFO: Scrape type for HZ20287: 2
2026-03-30 05:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-30 05:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with scrape type 2
2026-03-30 05:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with scrape type 2
2026-03-30 05:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e, identifier: HZ20287
2026-03-30 05:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-30 05:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287
2026-03-30 05:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e with identifier: HZ20287 to the API
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:16:21Z',
 'fuel_type': 'petrol',
 'id': '61a6e4d3-6e66-5927-be8c-c4b66c8cbd0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ20287',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 61032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2014}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-30 05:34:48 [auto1.de] INFO: Saving data for HZ20287: {'auction_closing_time': 1774883781.0, 'created_time': 1774552873.156279, 'last_price_update_time': 1774848888.030012}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ20287') HTTP/1.1" 204 0
2026-03-30 05:34:48 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 05:34:48 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-30 05:34:48 [auto1.de] INFO: Scrape type for FU20206: 2
2026-03-30 05:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with identifier: FU20206
2026-03-30 05:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with scrape type 2
2026-03-30 05:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with scrape type 2
2026-03-30 05:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe, identifier: FU20206
2026-03-30 05:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with identifier: FU20206
2026-03-30 05:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with identifier: FU20206
2026-03-30 05:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe with identifier: FU20206 to the API
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:48:33Z',
 'fuel_type': 'petrol',
 'id': 'a7f7ce0b-2b25-5a02-9e90-47b51a9e8bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU20206',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 68388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 LX',
 'transmission': 'manual',
 'trim': 'LX',
 'year': 2006}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-30 05:34:48 [auto1.de] INFO: Saving data for FU20206: {'auction_closing_time': 1774885713.0, 'created_time': 1774638954.000208, 'last_price_update_time': 1774848888.519293}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU20206') HTTP/1.1" 204 0
2026-03-30 05:34:48 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-30 05:34:48 [auto1.de] INFO: Scrape type for VE80218: 2
2026-03-30 05:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with identifier: VE80218
2026-03-30 05:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with scrape type 2
2026-03-30 05:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with scrape type 2
2026-03-30 05:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a476ab1-fb8f-5be0-95af-748a1ad8bec4, identifier: VE80218
2026-03-30 05:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with identifier: VE80218
2026-03-30 05:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with identifier: VE80218
2026-03-30 05:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a476ab1-fb8f-5be0-95af-748a1ad8bec4 with identifier: VE80218 to the API
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'petrol',
 'id': '7a476ab1-fb8f-5be0-95af-748a1ad8bec4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE80218',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 186284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-30 05:34:48 [auto1.de] INFO: Saving data for VE80218: {'auction_closing_time': 1774883000.0, 'created_time': 1774639394.172564, 'last_price_update_time': 1774848888.902058}
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE80218') HTTP/1.1" 204 0
2026-03-30 05:34:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:49 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-30 05:34:49 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-30 05:34:49 [auto1.de] INFO: Scrape type for RH04581: 2
2026-03-30 05:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-30 05:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755ad6e8-1745-5673-a185-0a347c03d37d with scrape type 2
2026-03-30 05:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755ad6e8-1745-5673-a185-0a347c03d37d with scrape type 2
2026-03-30 05:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 755ad6e8-1745-5673-a185-0a347c03d37d, identifier: RH04581
2026-03-30 05:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-30 05:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581
2026-03-30 05:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 755ad6e8-1745-5673-a185-0a347c03d37d with identifier: RH04581 to the API
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:33Z',
 'fuel_type': 'diesel',
 'id': '755ad6e8-1745-5673-a185-0a347c03d37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH04581',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 377125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-30 05:34:49 [auto1.de] INFO: Saving data for RH04581: {'auction_closing_time': 1774886133.0, 'created_time': 1774550348.474363, 'last_price_update_time': 1774848889.466524}
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH04581') HTTP/1.1" 204 0
2026-03-30 05:34:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-30 05:34:49 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-30 05:34:49 [auto1.de] INFO: Scrape type for HR62368: 2
2026-03-30 05:34:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df56e25-b868-56f1-9e68-234fa77d231f with identifier: HR62368
2026-03-30 05:34:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df56e25-b868-56f1-9e68-234fa77d231f with scrape type 2
2026-03-30 05:34:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7df56e25-b868-56f1-9e68-234fa77d231f with scrape type 2
2026-03-30 05:34:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7df56e25-b868-56f1-9e68-234fa77d231f, identifier: HR62368
2026-03-30 05:34:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7df56e25-b868-56f1-9e68-234fa77d231f with identifier: HR62368
2026-03-30 05:34:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7df56e25-b868-56f1-9e68-234fa77d231f with identifier: HR62368
2026-03-30 05:34:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7df56e25-b868-56f1-9e68-234fa77d231f with identifier: HR62368 to the API
2026-03-30 05:34:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:50:31Z',
 'fuel_type': 'diesel',
 'id': '7df56e25-b868-56f1-9e68-234fa77d231f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR62368',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 135935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-05',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Mild-Hybrid GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2021}
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Saving data for HR62368: {'auction_closing_time': 1774885831.0, 'created_time': 1773225616.049541, 'last_price_update_time': 1774848890.133369}
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR62368') HTTP/1.1" 204 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for GF78107: 2
2026-03-30 05:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-30 05:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd2c3f83-a98c-504f-9377-71f2da0f6d0f with scrape type 2
2026-03-30 05:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd2c3f83-a98c-504f-9377-71f2da0f6d0f with scrape type 2
2026-03-30 05:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd2c3f83-a98c-504f-9377-71f2da0f6d0f, identifier: GF78107
2026-03-30 05:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-30 05:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107
2026-03-30 05:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd2c3f83-a98c-504f-9377-71f2da0f6d0f with identifier: GF78107 to the API
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:09:10Z',
 'fuel_type': 'petrol',
 'id': 'fd2c3f83-a98c-504f-9377-71f2da0f6d0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF78107',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 74711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2013}
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Saving data for GF78107: {'auction_closing_time': 1774883350.0, 'created_time': 1774552678.255363, 'last_price_update_time': 1774848890.601712}
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF78107') HTTP/1.1" 204 0
2026-03-30 05:34:50 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-30 05:34:50 [auto1.de] INFO: Scrape type for CA34642: 2
2026-03-30 05:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fe0d492-677b-5463-8168-414e1b444059 with identifier: CA34642
2026-03-30 05:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fe0d492-677b-5463-8168-414e1b444059 with scrape type 2
2026-03-30 05:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fe0d492-677b-5463-8168-414e1b444059 with scrape type 2
2026-03-30 05:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fe0d492-677b-5463-8168-414e1b444059, identifier: CA34642
2026-03-30 05:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fe0d492-677b-5463-8168-414e1b444059 with identifier: CA34642
2026-03-30 05:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fe0d492-677b-5463-8168-414e1b444059 with identifier: CA34642
2026-03-30 05:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fe0d492-677b-5463-8168-414e1b444059 with identifier: CA34642 to the API
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:58Z',
 'fuel_type': 'petrol',
 'id': '6fe0d492-677b-5463-8168-414e1b444059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA34642',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 59760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-27',
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2022}
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Saving data for CA34642: {'auction_closing_time': 1774886338.0, 'created_time': 1774639349.125397, 'last_price_update_time': 1774848891.077683}
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA34642') HTTP/1.1" 204 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for JW84966: 2
2026-03-30 05:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca6dd8af-1e97-5b76-b6b7-d82687a1225b with identifier: JW84966
2026-03-30 05:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca6dd8af-1e97-5b76-b6b7-d82687a1225b with scrape type 2
2026-03-30 05:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca6dd8af-1e97-5b76-b6b7-d82687a1225b with scrape type 2
2026-03-30 05:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca6dd8af-1e97-5b76-b6b7-d82687a1225b, identifier: JW84966
2026-03-30 05:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca6dd8af-1e97-5b76-b6b7-d82687a1225b with identifier: JW84966
2026-03-30 05:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca6dd8af-1e97-5b76-b6b7-d82687a1225b with identifier: JW84966
2026-03-30 05:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca6dd8af-1e97-5b76-b6b7-d82687a1225b with identifier: JW84966 to the API
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:19:54Z',
 'fuel_type': 'petrol',
 'id': 'ca6dd8af-1e97-5b76-b6b7-d82687a1225b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW84966',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 50405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Saving data for JW84966: {'auction_closing_time': 1774883994.0, 'created_time': 1773224876.348765, 'last_price_update_time': 1774848891.622275}
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW84966') HTTP/1.1" 204 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for SM47095: 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-30 05:34:51 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-30 05:34:51 [auto1.de] INFO: Scrape type for RG31591: 2
2026-03-30 05:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24eec515-eb11-54b8-bd72-45f0d468d3b2 with identifier: RG31591
2026-03-30 05:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24eec515-eb11-54b8-bd72-45f0d468d3b2 with scrape type 2
2026-03-30 05:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24eec515-eb11-54b8-bd72-45f0d468d3b2 with scrape type 2
2026-03-30 05:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24eec515-eb11-54b8-bd72-45f0d468d3b2, identifier: RG31591
2026-03-30 05:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24eec515-eb11-54b8-bd72-45f0d468d3b2 with identifier: RG31591
2026-03-30 05:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24eec515-eb11-54b8-bd72-45f0d468d3b2 with identifier: RG31591
2026-03-30 05:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24eec515-eb11-54b8-bd72-45f0d468d3b2 with identifier: RG31591 to the API
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'petrol',
 'id': '24eec515-eb11-54b8-bd72-45f0d468d3b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG31591',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 66948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-27',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Saving data for RG31591: {'auction_closing_time': 1774886120.0, 'created_time': 1774636567.47824, 'last_price_update_time': 1774848892.099391}
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG31591') HTTP/1.1" 204 0
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Scrape type for WM09546: 0
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Scrape type for BR11811: 2
2026-03-30 05:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d2df88-6122-55f1-a343-33bdc897c3f8 with identifier: BR11811
2026-03-30 05:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d2df88-6122-55f1-a343-33bdc897c3f8 with scrape type 2
2026-03-30 05:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d2df88-6122-55f1-a343-33bdc897c3f8 with scrape type 2
2026-03-30 05:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d2df88-6122-55f1-a343-33bdc897c3f8, identifier: BR11811
2026-03-30 05:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d2df88-6122-55f1-a343-33bdc897c3f8 with identifier: BR11811
2026-03-30 05:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d2df88-6122-55f1-a343-33bdc897c3f8 with identifier: BR11811
2026-03-30 05:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d2df88-6122-55f1-a343-33bdc897c3f8 with identifier: BR11811 to the API
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:21Z',
 'fuel_type': 'diesel',
 'id': '66d2df88-6122-55f1-a343-33bdc897c3f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR11811',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 128272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Saving data for BR11811: {'auction_closing_time': 1774884201.0, 'created_time': 1774636347.183038, 'last_price_update_time': 1774848892.541906}
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR11811') HTTP/1.1" 204 0
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-30 05:34:52 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-30 05:34:52 [auto1.de] INFO: Scrape type for WG41390: 2
2026-03-30 05:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f7fb16-155f-502f-8e0c-abf0403f370c with identifier: WG41390
2026-03-30 05:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f7fb16-155f-502f-8e0c-abf0403f370c with scrape type 2
2026-03-30 05:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f7fb16-155f-502f-8e0c-abf0403f370c with scrape type 2
2026-03-30 05:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50f7fb16-155f-502f-8e0c-abf0403f370c, identifier: WG41390
2026-03-30 05:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50f7fb16-155f-502f-8e0c-abf0403f370c with identifier: WG41390
2026-03-30 05:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50f7fb16-155f-502f-8e0c-abf0403f370c with identifier: WG41390
2026-03-30 05:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50f7fb16-155f-502f-8e0c-abf0403f370c with identifier: WG41390 to the API
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'diesel',
 'id': '50f7fb16-155f-502f-8e0c-abf0403f370c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG41390',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 333239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-18',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Edition Comfort',
 'transmission': 'automatic',
 'trim': 'Edition Comfort',
 'year': 2007}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Saving data for WG41390: {'auction_closing_time': 1774883459.0, 'created_time': 1773946043.943145, 'last_price_update_time': 1774848893.054594}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG41390') HTTP/1.1" 204 0
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Scrape type for GJ62462: 2
2026-03-30 05:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-30 05:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f36a97-229a-5e8b-854a-f24bca1aeb86 with scrape type 2
2026-03-30 05:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f36a97-229a-5e8b-854a-f24bca1aeb86 with scrape type 2
2026-03-30 05:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52f36a97-229a-5e8b-854a-f24bca1aeb86, identifier: GJ62462
2026-03-30 05:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-30 05:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462
2026-03-30 05:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52f36a97-229a-5e8b-854a-f24bca1aeb86 with identifier: GJ62462 to the API
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:02:50Z',
 'fuel_type': 'petrol',
 'id': '52f36a97-229a-5e8b-854a-f24bca1aeb86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ62462',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 74704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-21',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2019}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Saving data for GJ62462: {'auction_closing_time': 1774882970.0, 'created_time': 1774552975.110339, 'last_price_update_time': 1774848893.472018}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ62462') HTTP/1.1" 204 0
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Scrape type for SC00063: 2
2026-03-30 05:34:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e41329-8f19-5544-b5c7-b676ca52e261 with identifier: SC00063
2026-03-30 05:34:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e41329-8f19-5544-b5c7-b676ca52e261 with scrape type 2
2026-03-30 05:34:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e41329-8f19-5544-b5c7-b676ca52e261 with scrape type 2
2026-03-30 05:34:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7e41329-8f19-5544-b5c7-b676ca52e261, identifier: SC00063
2026-03-30 05:34:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7e41329-8f19-5544-b5c7-b676ca52e261 with identifier: SC00063
2026-03-30 05:34:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7e41329-8f19-5544-b5c7-b676ca52e261 with identifier: SC00063
2026-03-30 05:34:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7e41329-8f19-5544-b5c7-b676ca52e261 with identifier: SC00063 to the API
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:37:02Z',
 'fuel_type': 'petrol',
 'id': 'f7e41329-8f19-5544-b5c7-b676ca52e261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC00063',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 164069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T6 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2017}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-30 05:34:53 [auto1.de] INFO: Saving data for SC00063: {'auction_closing_time': 1774885022.0, 'created_time': 1774435887.804378, 'last_price_update_time': 1774848893.910057}
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC00063') HTTP/1.1" 204 0
2026-03-30 05:34:53 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-30 05:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:54 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Scrape type for MT28952: 2
2026-03-30 05:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895c9568-05f6-59b7-9193-519cafa6be93 with identifier: MT28952
2026-03-30 05:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895c9568-05f6-59b7-9193-519cafa6be93 with scrape type 2
2026-03-30 05:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 895c9568-05f6-59b7-9193-519cafa6be93 with scrape type 2
2026-03-30 05:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 895c9568-05f6-59b7-9193-519cafa6be93, identifier: MT28952
2026-03-30 05:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 895c9568-05f6-59b7-9193-519cafa6be93 with identifier: MT28952
2026-03-30 05:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 895c9568-05f6-59b7-9193-519cafa6be93 with identifier: MT28952
2026-03-30 05:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 895c9568-05f6-59b7-9193-519cafa6be93 with identifier: MT28952 to the API
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:41:03Z',
 'fuel_type': 'petrol',
 'id': '895c9568-05f6-59b7-9193-519cafa6be93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT28952',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 197986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Saving data for MT28952: {'auction_closing_time': 1774885263.0, 'created_time': 1774550438.809337, 'last_price_update_time': 1774848894.427126}
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT28952') HTTP/1.1" 204 0
2026-03-30 05:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Scrape type for NK84600: 2
2026-03-30 05:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12b382b1-4a56-5c60-8bee-5add896a317e with identifier: NK84600
2026-03-30 05:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12b382b1-4a56-5c60-8bee-5add896a317e with scrape type 2
2026-03-30 05:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12b382b1-4a56-5c60-8bee-5add896a317e with scrape type 2
2026-03-30 05:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12b382b1-4a56-5c60-8bee-5add896a317e, identifier: NK84600
2026-03-30 05:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12b382b1-4a56-5c60-8bee-5add896a317e with identifier: NK84600
2026-03-30 05:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12b382b1-4a56-5c60-8bee-5add896a317e with identifier: NK84600
2026-03-30 05:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12b382b1-4a56-5c60-8bee-5add896a317e with identifier: NK84600 to the API
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'petrol',
 'id': '12b382b1-4a56-5c60-8bee-5add896a317e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK84600',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 119632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-25',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Saving data for NK84600: {'auction_closing_time': 1774884503.0, 'created_time': 1774032571.016598, 'last_price_update_time': 1774848894.849326}
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK84600') HTTP/1.1" 204 0
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Scrape type for AW88722: 0
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-30 05:34:54 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-30 05:34:54 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 05:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for TY75534: 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for CD75324: 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for AP34925: 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for ZJ19484: 2
2026-03-30 05:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-30 05:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82564df-113d-5196-898e-1f321830c20c with scrape type 2
2026-03-30 05:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82564df-113d-5196-898e-1f321830c20c with scrape type 2
2026-03-30 05:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82564df-113d-5196-898e-1f321830c20c, identifier: ZJ19484
2026-03-30 05:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-30 05:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484
2026-03-30 05:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82564df-113d-5196-898e-1f321830c20c with identifier: ZJ19484 to the API
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:53:51Z',
 'fuel_type': 'diesel',
 'id': 'f82564df-113d-5196-898e-1f321830c20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ19484',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 157645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L2H1 2,9t Expression',
 'transmission': 'manual',
 'trim': 'L2H1 2,9t Expression',
 'year': 2018}
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Saving data for ZJ19484: {'auction_closing_time': 1774886031.0, 'created_time': 1774553034.219747, 'last_price_update_time': 1774848895.433996}
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ19484') HTTP/1.1" 204 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for JB95370: 2
2026-03-30 05:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with identifier: JB95370
2026-03-30 05:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with scrape type 2
2026-03-30 05:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with scrape type 2
2026-03-30 05:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933, identifier: JB95370
2026-03-30 05:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with identifier: JB95370
2026-03-30 05:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with identifier: JB95370
2026-03-30 05:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933 with identifier: JB95370 to the API
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:33:14Z',
 'fuel_type': 'diesel',
 'id': 'fcaf39d5-13ef-5f9c-b8d7-4fdf6cb16933',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB95370',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 233497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-16',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Saving data for JB95370: {'auction_closing_time': 1774884794.0, 'created_time': 1774550128.893845, 'last_price_update_time': 1774848895.839678}
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB95370') HTTP/1.1" 204 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-30 05:34:55 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 05:34:55 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for CR83846: 2
2026-03-30 05:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3f1764-65de-523e-a7c0-df94863c432d with identifier: CR83846
2026-03-30 05:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3f1764-65de-523e-a7c0-df94863c432d with scrape type 2
2026-03-30 05:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b3f1764-65de-523e-a7c0-df94863c432d with scrape type 2
2026-03-30 05:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b3f1764-65de-523e-a7c0-df94863c432d, identifier: CR83846
2026-03-30 05:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b3f1764-65de-523e-a7c0-df94863c432d with identifier: CR83846
2026-03-30 05:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b3f1764-65de-523e-a7c0-df94863c432d with identifier: CR83846
2026-03-30 05:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b3f1764-65de-523e-a7c0-df94863c432d with identifier: CR83846 to the API
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:11:32Z',
 'fuel_type': 'petrol',
 'id': '7b3f1764-65de-523e-a7c0-df94863c432d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR83846',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 137340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Saving data for CR83846: {'auction_closing_time': 1774883492.0, 'created_time': 1774637656.915898, 'last_price_update_time': 1774848896.416996}
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR83846') HTTP/1.1" 204 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for NP05566: 2
2026-03-30 05:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d83ddf0d-54ca-554a-a668-e406b077023c with identifier: NP05566
2026-03-30 05:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d83ddf0d-54ca-554a-a668-e406b077023c with scrape type 2
2026-03-30 05:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d83ddf0d-54ca-554a-a668-e406b077023c with scrape type 2
2026-03-30 05:34:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d83ddf0d-54ca-554a-a668-e406b077023c, identifier: NP05566
2026-03-30 05:34:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d83ddf0d-54ca-554a-a668-e406b077023c with identifier: NP05566
2026-03-30 05:34:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d83ddf0d-54ca-554a-a668-e406b077023c with identifier: NP05566
2026-03-30 05:34:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d83ddf0d-54ca-554a-a668-e406b077023c with identifier: NP05566 to the API
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:12:13Z',
 'fuel_type': 'petrol',
 'id': 'd83ddf0d-54ca-554a-a668-e406b077023c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP05566',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 25628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-26',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Experience',
 'transmission': 'automatic',
 'trim': 'Experience',
 'year': 2020}
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Saving data for NP05566: {'auction_closing_time': 1774883533.0, 'created_time': 1774639157.244329, 'last_price_update_time': 1774848896.859643}
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP05566') HTTP/1.1" 204 0
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 05:34:56 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-30 05:34:56 [auto1.de] INFO: Scrape type for RL83292: 2
2026-03-30 05:34:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with identifier: RL83292
2026-03-30 05:34:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with scrape type 2
2026-03-30 05:34:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with scrape type 2
2026-03-30 05:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d, identifier: RL83292
2026-03-30 05:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with identifier: RL83292
2026-03-30 05:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with identifier: RL83292
2026-03-30 05:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d with identifier: RL83292 to the API
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:35:25Z',
 'fuel_type': 'petrol',
 'id': 'e9fdcc17-85ba-5eae-bf1f-2faa0bc4dd1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL83292',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 130045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-10',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-30 05:34:57 [auto1.de] INFO: Saving data for RL83292: {'auction_closing_time': 1774884925.0, 'created_time': 1773133930.931373, 'last_price_update_time': 1774848897.382685}
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL83292') HTTP/1.1" 204 0
2026-03-30 05:34:57 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 05:34:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:34:57 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6742 | hits on page: 40
2026-03-30 05:34:57 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-30 05:34:57 [auto1.de] INFO: Scrape type for MP93113: 2
2026-03-30 05:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with identifier: MP93113
2026-03-30 05:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with scrape type 2
2026-03-30 05:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with scrape type 2
2026-03-30 05:34:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eedaa1e-6227-51d7-a9c3-5635e1e465ba, identifier: MP93113
2026-03-30 05:34:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with identifier: MP93113
2026-03-30 05:34:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with identifier: MP93113
2026-03-30 05:34:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eedaa1e-6227-51d7-a9c3-5635e1e465ba with identifier: MP93113 to the API
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:51Z',
 'fuel_type': 'diesel',
 'id': '6eedaa1e-6227-51d7-a9c3-5635e1e465ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP93113',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 233235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-06',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2013}
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-30 05:34:57 [auto1.de] INFO: Saving data for MP93113: {'auction_closing_time': 1774883391.0, 'created_time': 1774549886.54015, 'last_price_update_time': 1774848897.897012}
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP93113') HTTP/1.1" 204 0
2026-03-30 05:34:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:34:57 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 05:34:57 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-30 05:34:57 [auto1.de] INFO: Scrape type for VX99653: 2
2026-03-30 05:34:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 847fae9b-f137-5c35-862a-71c8e7bb815a with identifier: VX99653
2026-03-30 05:34:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 847fae9b-f137-5c35-862a-71c8e7bb815a with scrape type 2
2026-03-30 05:34:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 847fae9b-f137-5c35-862a-71c8e7bb815a with scrape type 2
2026-03-30 05:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 847fae9b-f137-5c35-862a-71c8e7bb815a, identifier: VX99653
2026-03-30 05:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 847fae9b-f137-5c35-862a-71c8e7bb815a with identifier: VX99653
2026-03-30 05:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 847fae9b-f137-5c35-862a-71c8e7bb815a with identifier: VX99653
2026-03-30 05:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 847fae9b-f137-5c35-862a-71c8e7bb815a with identifier: VX99653 to the API
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:04Z',
 'fuel_type': 'petrol',
 'id': '847fae9b-f137-5c35-862a-71c8e7bb815a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX99653',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 188067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2011}
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Saving data for VX99653: {'auction_closing_time': 1774886044.0, 'created_time': 1773305517.362753, 'last_price_update_time': 1774848898.336323}
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX99653') HTTP/1.1" 204 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for PY88123: 2
2026-03-30 05:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-30 05:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a7da3a-773e-5548-aeb7-4c4050cec14c with scrape type 2
2026-03-30 05:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87a7da3a-773e-5548-aeb7-4c4050cec14c with scrape type 2
2026-03-30 05:34:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a7da3a-773e-5548-aeb7-4c4050cec14c, identifier: PY88123
2026-03-30 05:34:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-30 05:34:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123
2026-03-30 05:34:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a7da3a-773e-5548-aeb7-4c4050cec14c with identifier: PY88123 to the API
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-30T15:56:28Z',
 'fuel_type': 'petrol',
 'id': '87a7da3a-773e-5548-aeb7-4c4050cec14c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY88123',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 26500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2024}
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Saving data for PY88123: {'auction_closing_time': 1774886188.0, 'created_time': 1774552967.664915, 'last_price_update_time': 1774848898.73685}
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY88123') HTTP/1.1" 204 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for BB98458: 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-30 05:34:58 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-30 05:34:58 [auto1.de] INFO: Scrape type for GM35887: 2
2026-03-30 05:34:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2226e419-dfab-51a6-bc5d-fa043f79da3b with identifier: GM35887
2026-03-30 05:34:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2226e419-dfab-51a6-bc5d-fa043f79da3b with scrape type 2
2026-03-30 05:34:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2226e419-dfab-51a6-bc5d-fa043f79da3b with scrape type 2
2026-03-30 05:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2226e419-dfab-51a6-bc5d-fa043f79da3b, identifier: GM35887
2026-03-30 05:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2226e419-dfab-51a6-bc5d-fa043f79da3b with identifier: GM35887
2026-03-30 05:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2226e419-dfab-51a6-bc5d-fa043f79da3b with identifier: GM35887
2026-03-30 05:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2226e419-dfab-51a6-bc5d-fa043f79da3b with identifier: GM35887 to the API
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:29Z',
 'fuel_type': 'diesel',
 'id': '2226e419-dfab-51a6-bc5d-fa043f79da3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM35887',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 256827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-02',
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Saving data for GM35887: {'auction_closing_time': 1774885709.0, 'created_time': 1774349909.575187, 'last_price_update_time': 1774848899.324874}
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM35887') HTTP/1.1" 204 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for KC26030: 2
2026-03-30 05:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with identifier: KC26030
2026-03-30 05:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with scrape type 2
2026-03-30 05:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with scrape type 2
2026-03-30 05:34:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e, identifier: KC26030
2026-03-30 05:34:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with identifier: KC26030
2026-03-30 05:34:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with identifier: KC26030
2026-03-30 05:34:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e with identifier: KC26030 to the API
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:34:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:27Z',
 'fuel_type': 'petrol',
 'id': '1c009bb4-fe24-50fc-95ef-8fcbbcc7d33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC26030',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 24141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Freestyle',
 'transmission': 'manual',
 'trim': 'Freestyle',
 'year': 2010}
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Saving data for KC26030: {'auction_closing_time': 1774882947.0, 'created_time': 1774034241.784073, 'last_price_update_time': 1774848899.826066}
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC26030') HTTP/1.1" 204 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 05:34:59 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:34:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-30 05:34:59 [auto1.de] INFO: Scrape type for ZE29906: 2
2026-03-30 05:34:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffce1765-edd1-5e53-b067-fcbe6c2631ee with identifier: ZE29906
2026-03-30 05:34:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffce1765-edd1-5e53-b067-fcbe6c2631ee with scrape type 2
2026-03-30 05:34:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffce1765-edd1-5e53-b067-fcbe6c2631ee with scrape type 2
2026-03-30 05:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffce1765-edd1-5e53-b067-fcbe6c2631ee, identifier: ZE29906
2026-03-30 05:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffce1765-edd1-5e53-b067-fcbe6c2631ee with identifier: ZE29906
2026-03-30 05:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffce1765-edd1-5e53-b067-fcbe6c2631ee with identifier: ZE29906
2026-03-30 05:35:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffce1765-edd1-5e53-b067-fcbe6c2631ee with identifier: ZE29906 to the API
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'petrol',
 'id': 'ffce1765-edd1-5e53-b067-fcbe6c2631ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE29906',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 57422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-14',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-30 05:35:00 [auto1.de] INFO: Saving data for ZE29906: {'auction_closing_time': 1774886122.0, 'created_time': 1773342068.124907, 'last_price_update_time': 1774848900.339096}
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE29906') HTTP/1.1" 204 0
2026-03-30 05:35:00 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-30 05:35:00 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-30 05:35:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:00 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:00 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 05:35:00 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-30 05:35:00 [auto1.de] INFO: Scrape type for LL09458: 2
2026-03-30 05:35:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-30 05:35:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5942ad7-b395-525b-8cf9-a58fcdd5027f with scrape type 2
2026-03-30 05:35:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5942ad7-b395-525b-8cf9-a58fcdd5027f with scrape type 2
2026-03-30 05:35:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5942ad7-b395-525b-8cf9-a58fcdd5027f, identifier: LL09458
2026-03-30 05:35:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-30 05:35:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458
2026-03-30 05:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5942ad7-b395-525b-8cf9-a58fcdd5027f with identifier: LL09458 to the API
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:27:45Z',
 'fuel_type': 'petrol',
 'id': 'b5942ad7-b395-525b-8cf9-a58fcdd5027f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL09458',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 124064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-24',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2017}
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-30 05:35:01 [auto1.de] INFO: Saving data for LL09458: {'auction_closing_time': 1774884465.0, 'created_time': 1774589451.804471, 'last_price_update_time': 1774848901.219503}
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL09458') HTTP/1.1" 204 0
2026-03-30 05:35:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:01 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-30 05:35:01 [auto1.de] INFO: Scrape type for AU82814: 2
2026-03-30 05:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb72e491-662c-548a-8764-8d9775011afb with identifier: AU82814
2026-03-30 05:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb72e491-662c-548a-8764-8d9775011afb with scrape type 2
2026-03-30 05:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb72e491-662c-548a-8764-8d9775011afb with scrape type 2
2026-03-30 05:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb72e491-662c-548a-8764-8d9775011afb, identifier: AU82814
2026-03-30 05:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb72e491-662c-548a-8764-8d9775011afb with identifier: AU82814
2026-03-30 05:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb72e491-662c-548a-8764-8d9775011afb with identifier: AU82814
2026-03-30 05:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb72e491-662c-548a-8764-8d9775011afb with identifier: AU82814 to the API
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:53:07Z',
 'fuel_type': 'petrol',
 'id': 'bb72e491-662c-548a-8764-8d9775011afb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU82814',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 118502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-30 05:35:01 [auto1.de] INFO: Saving data for AU82814: {'auction_closing_time': 1774885987.0, 'created_time': 1774637251.812969, 'last_price_update_time': 1774848901.633584}
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU82814') HTTP/1.1" 204 0
2026-03-30 05:35:01 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-30 05:35:01 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-30 05:35:01 [auto1.de] INFO: Scrape type for HH56316: 0
2026-03-30 05:35:01 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-30 05:35:01 [auto1.de] INFO: Scrape type for XY67519: 2
2026-03-30 05:35:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with identifier: XY67519
2026-03-30 05:35:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with scrape type 2
2026-03-30 05:35:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with scrape type 2
2026-03-30 05:35:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea, identifier: XY67519
2026-03-30 05:35:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with identifier: XY67519
2026-03-30 05:35:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with identifier: XY67519
2026-03-30 05:35:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0200fce1-5a8d-58f2-84c7-9ca7d17bbcea with identifier: XY67519 to the API
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:26:46Z',
 'fuel_type': 'petrol',
 'id': '0200fce1-5a8d-58f2-84c7-9ca7d17bbcea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY67519',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 191859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-18',
 'seller_name': None,
 'title': 'BMW 2er 220i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-30 05:35:02 [auto1.de] INFO: Saving data for XY67519: {'auction_closing_time': 1774884406.0, 'created_time': 1774349625.93613, 'last_price_update_time': 1774848902.085389}
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY67519') HTTP/1.1" 204 0
2026-03-30 05:35:02 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-30 05:35:02 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-30 05:35:02 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-30 05:35:02 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-30 05:35:02 [auto1.de] INFO: Scrape type for VT42792: 2
2026-03-30 05:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with identifier: VT42792
2026-03-30 05:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with scrape type 2
2026-03-30 05:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with scrape type 2
2026-03-30 05:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb, identifier: VT42792
2026-03-30 05:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with identifier: VT42792
2026-03-30 05:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with identifier: VT42792
2026-03-30 05:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0ea3e0-a156-5c78-94f1-e55162e5ccbb with identifier: VT42792 to the API
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:08:32Z',
 'fuel_type': 'diesel',
 'id': '7a0ea3e0-a156-5c78-94f1-e55162e5ccbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT42792',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 25314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 112 CDI Pro lang',
 'transmission': 'automatic',
 'trim': 'Pro lang',
 'year': 2024}
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-30 05:35:02 [auto1.de] INFO: Saving data for VT42792: {'auction_closing_time': 1774883312.0, 'created_time': 1773131991.934019, 'last_price_update_time': 1774848902.582504}
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT42792') HTTP/1.1" 204 0
2026-03-30 05:35:02 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-30 05:35:02 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-30 05:35:02 [auto1.de] INFO: Scrape type for FX25662: 2
2026-03-30 05:35:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with identifier: FX25662
2026-03-30 05:35:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with scrape type 2
2026-03-30 05:35:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with scrape type 2
2026-03-30 05:35:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bdf76c5-2aaa-5129-9690-8c28dff925d9, identifier: FX25662
2026-03-30 05:35:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with identifier: FX25662
2026-03-30 05:35:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with identifier: FX25662
2026-03-30 05:35:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bdf76c5-2aaa-5129-9690-8c28dff925d9 with identifier: FX25662 to the API
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:55Z',
 'fuel_type': 'diesel',
 'id': '0bdf76c5-2aaa-5129-9690-8c28dff925d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX25662',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 236764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-03',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-30 05:35:03 [auto1.de] INFO: Saving data for FX25662: {'auction_closing_time': 1774885975.0, 'created_time': 1774549849.761074, 'last_price_update_time': 1774848903.04389}
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX25662') HTTP/1.1" 204 0
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-30 05:35:03 [auto1.de] INFO: Scrape type for RX80548: 2
2026-03-30 05:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cc785a-dbf2-5f11-8136-259c90e994b3 with identifier: RX80548
2026-03-30 05:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cc785a-dbf2-5f11-8136-259c90e994b3 with scrape type 2
2026-03-30 05:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37cc785a-dbf2-5f11-8136-259c90e994b3 with scrape type 2
2026-03-30 05:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cc785a-dbf2-5f11-8136-259c90e994b3, identifier: RX80548
2026-03-30 05:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cc785a-dbf2-5f11-8136-259c90e994b3 with identifier: RX80548
2026-03-30 05:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cc785a-dbf2-5f11-8136-259c90e994b3 with identifier: RX80548
2026-03-30 05:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cc785a-dbf2-5f11-8136-259c90e994b3 with identifier: RX80548 to the API
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:27:04Z',
 'fuel_type': 'petrol',
 'id': '37cc785a-dbf2-5f11-8136-259c90e994b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX80548',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 36323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-23',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-30 05:35:03 [auto1.de] INFO: Saving data for RX80548: {'auction_closing_time': 1774884424.0, 'created_time': 1774636800.42708, 'last_price_update_time': 1774848903.547516}
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX80548') HTTP/1.1" 204 0
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-30 05:35:03 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 05:35:03 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-30 05:35:03 [auto1.de] INFO: Scrape type for WX91762: 2
2026-03-30 05:35:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74858eeb-9e02-5971-900e-fa2f1c362d98 with identifier: WX91762
2026-03-30 05:35:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74858eeb-9e02-5971-900e-fa2f1c362d98 with scrape type 2
2026-03-30 05:35:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74858eeb-9e02-5971-900e-fa2f1c362d98 with scrape type 2
2026-03-30 05:35:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74858eeb-9e02-5971-900e-fa2f1c362d98, identifier: WX91762
2026-03-30 05:35:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74858eeb-9e02-5971-900e-fa2f1c362d98 with identifier: WX91762
2026-03-30 05:35:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74858eeb-9e02-5971-900e-fa2f1c362d98 with identifier: WX91762
2026-03-30 05:35:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74858eeb-9e02-5971-900e-fa2f1c362d98 with identifier: WX91762 to the API
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:58:21Z',
 'fuel_type': 'petrol',
 'id': '74858eeb-9e02-5971-900e-fa2f1c362d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX91762',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 162316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Saving data for WX91762: {'auction_closing_time': 1774886301.0, 'created_time': 1774639293.08775, 'last_price_update_time': 1774848904.054845}
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX91762') HTTP/1.1" 204 0
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Scrape type for YT57989: 0
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Scrape type for NF38330: 2
2026-03-30 05:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-30 05:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with scrape type 2
2026-03-30 05:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with scrape type 2
2026-03-30 05:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7, identifier: NF38330
2026-03-30 05:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-30 05:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330
2026-03-30 05:35:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f8087f-cbe4-5fbb-96aa-e89f85f016c7 with identifier: NF38330 to the API
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:24Z',
 'fuel_type': 'petrol',
 'id': '17f8087f-cbe4-5fbb-96aa-e89f85f016c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF38330',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 99812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-02',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Saving data for NF38330: {'auction_closing_time': 1774886064.0, 'created_time': 1774675846.960755, 'last_price_update_time': 1774848904.529538}
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF38330') HTTP/1.1" 204 0
2026-03-30 05:35:04 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-30 05:35:04 [auto1.de] INFO: Scrape type for WN67073: 2
2026-03-30 05:35:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40156e37-58a5-5c09-9698-4c92f05e3a16 with identifier: WN67073
2026-03-30 05:35:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40156e37-58a5-5c09-9698-4c92f05e3a16 with scrape type 2
2026-03-30 05:35:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40156e37-58a5-5c09-9698-4c92f05e3a16 with scrape type 2
2026-03-30 05:35:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40156e37-58a5-5c09-9698-4c92f05e3a16, identifier: WN67073
2026-03-30 05:35:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40156e37-58a5-5c09-9698-4c92f05e3a16 with identifier: WN67073
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 05:35:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:35:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:35:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40156e37-58a5-5c09-9698-4c92f05e3a16 with identifier: WN67073
2026-03-30 05:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40156e37-58a5-5c09-9698-4c92f05e3a16 with identifier: WN67073 to the API
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:34:36Z',
 'fuel_type': 'petrol',
 'id': '40156e37-58a5-5c09-9698-4c92f05e3a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN67073',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 29204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-21',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Yours Trim',
 'transmission': 'automatic',
 'trim': 'Yours Trim',
 'year': 2024}
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Saving data for WN67073: {'auction_closing_time': 1774884876.0, 'created_time': 1773345638.969945, 'last_price_update_time': 1774848905.284708}
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN67073') HTTP/1.1" 204 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for CM15300: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for ND34621: 2
2026-03-30 05:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-03-30 05:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9861f69c-f16a-51aa-8c37-7979aede0499 with scrape type 2
2026-03-30 05:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9861f69c-f16a-51aa-8c37-7979aede0499 with scrape type 2
2026-03-30 05:35:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9861f69c-f16a-51aa-8c37-7979aede0499, identifier: ND34621
2026-03-30 05:35:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-03-30 05:35:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621
2026-03-30 05:35:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9861f69c-f16a-51aa-8c37-7979aede0499 with identifier: ND34621 to the API
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:16:27Z',
 'fuel_type': 'diesel',
 'id': '9861f69c-f16a-51aa-8c37-7979aede0499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND34621',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 115963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-06',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Saving data for ND34621: {'auction_closing_time': 1774883787.0, 'created_time': 1774638956.149051, 'last_price_update_time': 1774848905.863851}
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND34621') HTTP/1.1" 204 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-30 05:35:05 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-30 05:35:05 [auto1.de] INFO: Scrape type for EY95124: 2
2026-03-30 05:35:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dc2027c-d83e-5c5a-b628-f74075882a87 with identifier: EY95124
2026-03-30 05:35:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dc2027c-d83e-5c5a-b628-f74075882a87 with scrape type 2
2026-03-30 05:35:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dc2027c-d83e-5c5a-b628-f74075882a87 with scrape type 2
2026-03-30 05:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dc2027c-d83e-5c5a-b628-f74075882a87, identifier: EY95124
2026-03-30 05:35:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dc2027c-d83e-5c5a-b628-f74075882a87 with identifier: EY95124
2026-03-30 05:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dc2027c-d83e-5c5a-b628-f74075882a87 with identifier: EY95124
2026-03-30 05:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dc2027c-d83e-5c5a-b628-f74075882a87 with identifier: EY95124 to the API
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:01Z',
 'fuel_type': 'petrol',
 'id': '7dc2027c-d83e-5c5a-b628-f74075882a87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY95124',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 32660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-24',
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-30 05:35:06 [auto1.de] INFO: Saving data for EY95124: {'auction_closing_time': 1774886281.0, 'created_time': 1774639319.611811, 'last_price_update_time': 1774848906.360471}
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY95124') HTTP/1.1" 204 0
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-30 05:35:06 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-30 05:35:06 [auto1.de] INFO: Scrape type for BT97147: 2
2026-03-30 05:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-30 05:35:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bdfc631-9e77-5990-b593-060e40391d94 with scrape type 2
2026-03-30 05:35:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bdfc631-9e77-5990-b593-060e40391d94 with scrape type 2
2026-03-30 05:35:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bdfc631-9e77-5990-b593-060e40391d94, identifier: BT97147
2026-03-30 05:35:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-30 05:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147
2026-03-30 05:35:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bdfc631-9e77-5990-b593-060e40391d94 with identifier: BT97147 to the API
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:06:58Z',
 'fuel_type': 'petrol',
 'id': '6bdfc631-9e77-5990-b593-060e40391d94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT97147',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 92211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-30 05:35:06 [auto1.de] INFO: Saving data for BT97147: {'auction_closing_time': 1774883218.0, 'created_time': 1774550351.53723, 'last_price_update_time': 1774848906.941275}
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT97147') HTTP/1.1" 204 0
2026-03-30 05:35:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:06 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 14 pages/min), scraped 299 items (at 108 items/min)
2026-03-30 05:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-30 05:35:06 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-30 05:35:06 [auto1.de] INFO: Scrape type for TF71705: 0
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-30 05:35:06 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-30 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for DP30062: 2
2026-03-30 05:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d28c3df3-76e7-5c3a-974a-70179012f5a1 with identifier: DP30062
2026-03-30 05:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d28c3df3-76e7-5c3a-974a-70179012f5a1 with scrape type 2
2026-03-30 05:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d28c3df3-76e7-5c3a-974a-70179012f5a1 with scrape type 2
2026-03-30 05:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d28c3df3-76e7-5c3a-974a-70179012f5a1, identifier: DP30062
2026-03-30 05:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d28c3df3-76e7-5c3a-974a-70179012f5a1 with identifier: DP30062
2026-03-30 05:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d28c3df3-76e7-5c3a-974a-70179012f5a1 with identifier: DP30062
2026-03-30 05:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d28c3df3-76e7-5c3a-974a-70179012f5a1 with identifier: DP30062 to the API
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:12:08Z',
 'fuel_type': 'petrol',
 'id': 'd28c3df3-76e7-5c3a-974a-70179012f5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP30062',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLC-Klasse',
 'odometer': 132163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLC-Klasse CLC 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Saving data for DP30062: {'auction_closing_time': 1774883528.0, 'created_time': 1774636650.560094, 'last_price_update_time': 1774848907.418412}
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP30062') HTTP/1.1" 204 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for YJ47814: 2
2026-03-30 05:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-30 05:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9936cd23-f63b-558a-9466-c755649fc40f with scrape type 2
2026-03-30 05:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9936cd23-f63b-558a-9466-c755649fc40f with scrape type 2
2026-03-30 05:35:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9936cd23-f63b-558a-9466-c755649fc40f, identifier: YJ47814
2026-03-30 05:35:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-30 05:35:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814
2026-03-30 05:35:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9936cd23-f63b-558a-9466-c755649fc40f with identifier: YJ47814 to the API
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:33:05Z',
 'fuel_type': 'hybrid',
 'id': '9936cd23-f63b-558a-9466-c755649fc40f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ47814',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 50444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-05',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Saving data for YJ47814: {'auction_closing_time': 1774884785.0, 'created_time': 1774553059.022454, 'last_price_update_time': 1774848907.937094}
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ47814') HTTP/1.1" 204 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for AG08443: 0
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-30 05:35:07 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-30 05:35:07 [auto1.de] INFO: Scrape type for XZ76786: 2
2026-03-30 05:35:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with identifier: XZ76786
2026-03-30 05:35:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with scrape type 2
2026-03-30 05:35:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with scrape type 2
2026-03-30 05:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e, identifier: XZ76786
2026-03-30 05:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with identifier: XZ76786
2026-03-30 05:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with identifier: XZ76786
2026-03-30 05:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e with identifier: XZ76786 to the API
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:44:17Z',
 'fuel_type': 'diesel',
 'id': '4469ba46-d1eb-5f1a-8ab0-5b9c29ad9f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ76786',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 210332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-14',
 'seller_name': None,
 'title': 'Saab 9-3 1.9 TTiD Vector',
 'transmission': 'manual',
 'trim': 'Vector',
 'year': 2011}
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-30 05:35:08 [auto1.de] INFO: Saving data for XZ76786: {'auction_closing_time': 1774885457.0, 'created_time': 1774521341.362581, 'last_price_update_time': 1774848908.355345}
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ76786') HTTP/1.1" 204 0
2026-03-30 05:35:08 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-30 05:35:08 [auto1.de] INFO: Scrape type for TD56842: 2
2026-03-30 05:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with identifier: TD56842
2026-03-30 05:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with scrape type 2
2026-03-30 05:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with scrape type 2
2026-03-30 05:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1, identifier: TD56842
2026-03-30 05:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with identifier: TD56842
2026-03-30 05:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with identifier: TD56842
2026-03-30 05:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a07ee8-15df-5bf0-ab8c-2c4601fe38f1 with identifier: TD56842 to the API
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'diesel',
 'id': '29a07ee8-15df-5bf0-ab8c-2c4601fe38f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD56842',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 396436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-27',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi 335 L2H2 TwinCab Edition HDi 130',
 'transmission': 'manual',
 'trim': '335 L2H2 TwinCab Edition HDi 130',
 'year': 2014}
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-30 05:35:08 [auto1.de] INFO: Saving data for TD56842: {'auction_closing_time': 1774884983.0, 'created_time': 1774435795.389325, 'last_price_update_time': 1774848908.76126}
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD56842') HTTP/1.1" 204 0
2026-03-30 05:35:08 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-30 05:35:08 [auto1.de] INFO: Scrape type for AJ16531: 2
2026-03-30 05:35:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 898c6e43-fc15-51ff-a54c-807cd3775178 with identifier: AJ16531
2026-03-30 05:35:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 898c6e43-fc15-51ff-a54c-807cd3775178 with scrape type 2
2026-03-30 05:35:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 898c6e43-fc15-51ff-a54c-807cd3775178 with scrape type 2
2026-03-30 05:35:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 898c6e43-fc15-51ff-a54c-807cd3775178, identifier: AJ16531
2026-03-30 05:35:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 898c6e43-fc15-51ff-a54c-807cd3775178 with identifier: AJ16531
2026-03-30 05:35:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 898c6e43-fc15-51ff-a54c-807cd3775178 with identifier: AJ16531
2026-03-30 05:35:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 898c6e43-fc15-51ff-a54c-807cd3775178 with identifier: AJ16531 to the API
2026-03-30 05:35:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:01:49Z',
 'fuel_type': 'petrol',
 'id': '898c6e43-fc15-51ff-a54c-807cd3775178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ16531',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 92299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-30 05:35:09 [auto1.de] INFO: Saving data for AJ16531: {'auction_closing_time': 1774882909.0, 'created_time': 1774521856.625188, 'last_price_update_time': 1774848909.216505}
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ16531') HTTP/1.1" 204 0
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-30 05:35:09 [auto1.de] INFO: Scrape type for KX12116: 2
2026-03-30 05:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with identifier: KX12116
2026-03-30 05:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with scrape type 2
2026-03-30 05:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with scrape type 2
2026-03-30 05:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a, identifier: KX12116
2026-03-30 05:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with identifier: KX12116
2026-03-30 05:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with identifier: KX12116
2026-03-30 05:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c36f7ee-1e70-55e8-b0fe-70ad523aae1a with identifier: KX12116 to the API
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:33Z',
 'fuel_type': 'petrol',
 'id': '3c36f7ee-1e70-55e8-b0fe-70ad523aae1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX12116',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 42408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-30 05:35:09 [auto1.de] INFO: Saving data for KX12116: {'auction_closing_time': 1774885533.0, 'created_time': 1774637980.671676, 'last_price_update_time': 1774848909.606045}
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX12116') HTTP/1.1" 204 0
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-30 05:35:09 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-30 05:35:09 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-30 05:35:09 [auto1.de] INFO: Scrape type for VB93359: 2
2026-03-30 05:35:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-30 05:35:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with scrape type 2
2026-03-30 05:35:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with scrape type 2
2026-03-30 05:35:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb, identifier: VB93359
2026-03-30 05:35:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-30 05:35:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359
2026-03-30 05:35:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02df93b2-897d-5ea7-9f37-9ee2e441cfbb with identifier: VB93359 to the API
2026-03-30 05:35:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:12Z',
 'fuel_type': 'diesel',
 'id': '02df93b2-897d-5ea7-9f37-9ee2e441cfbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB93359',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 60458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI Elegance L (L3)',
 'transmission': 'automatic',
 'trim': 'Elegance L (L3)',
 'year': 2021}
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-30 05:35:10 [auto1.de] INFO: Saving data for VB93359: {'auction_closing_time': 1774883712.0, 'created_time': 1774552491.216636, 'last_price_update_time': 1774848910.109214}
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB93359') HTTP/1.1" 204 0
2026-03-30 05:35:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-30 05:35:10 [auto1.de] INFO: Scrape type for RK12906: 2
2026-03-30 05:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be4f9de-7457-527d-8c95-56be648a7781 with identifier: RK12906
2026-03-30 05:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be4f9de-7457-527d-8c95-56be648a7781 with scrape type 2
2026-03-30 05:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be4f9de-7457-527d-8c95-56be648a7781 with scrape type 2
2026-03-30 05:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9be4f9de-7457-527d-8c95-56be648a7781, identifier: RK12906
2026-03-30 05:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9be4f9de-7457-527d-8c95-56be648a7781 with identifier: RK12906
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 05:35:10 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9be4f9de-7457-527d-8c95-56be648a7781 with identifier: RK12906
2026-03-30 05:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9be4f9de-7457-527d-8c95-56be648a7781 with identifier: RK12906 to the API
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'petrol',
 'id': '9be4f9de-7457-527d-8c95-56be648a7781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12906',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 135390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2015}
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-30 05:35:10 [auto1.de] INFO: Saving data for RK12906: {'auction_closing_time': 1774885507.0, 'created_time': 1774639051.759421, 'last_price_update_time': 1774848910.631309}
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK12906') HTTP/1.1" 204 0
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-30 05:35:10 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-30 05:35:10 [auto1.de] INFO: Scrape type for GJ61824: 2
2026-03-30 05:35:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d659aca6-3af8-592b-8ac6-912e58758ca9 with identifier: GJ61824
2026-03-30 05:35:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d659aca6-3af8-592b-8ac6-912e58758ca9 with scrape type 2
2026-03-30 05:35:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d659aca6-3af8-592b-8ac6-912e58758ca9 with scrape type 2
2026-03-30 05:35:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d659aca6-3af8-592b-8ac6-912e58758ca9, identifier: GJ61824
2026-03-30 05:35:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d659aca6-3af8-592b-8ac6-912e58758ca9 with identifier: GJ61824
2026-03-30 05:35:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d659aca6-3af8-592b-8ac6-912e58758ca9 with identifier: GJ61824
2026-03-30 05:35:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d659aca6-3af8-592b-8ac6-912e58758ca9 with identifier: GJ61824 to the API
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:51:46Z',
 'fuel_type': 'diesel',
 'id': 'd659aca6-3af8-592b-8ac6-912e58758ca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ61824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 297666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T 4Matic BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Saving data for GJ61824: {'auction_closing_time': 1774885906.0, 'created_time': 1774549883.670109, 'last_price_update_time': 1774848911.044979}
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ61824') HTTP/1.1" 204 0
2026-03-30 05:35:11 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for XG02124: 2
2026-03-30 05:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac0f350-ed89-5582-a115-bbc19f07d87e with identifier: XG02124
2026-03-30 05:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac0f350-ed89-5582-a115-bbc19f07d87e with scrape type 2
2026-03-30 05:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ac0f350-ed89-5582-a115-bbc19f07d87e with scrape type 2
2026-03-30 05:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ac0f350-ed89-5582-a115-bbc19f07d87e, identifier: XG02124
2026-03-30 05:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ac0f350-ed89-5582-a115-bbc19f07d87e with identifier: XG02124
2026-03-30 05:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ac0f350-ed89-5582-a115-bbc19f07d87e with identifier: XG02124
2026-03-30 05:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ac0f350-ed89-5582-a115-bbc19f07d87e with identifier: XG02124 to the API
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:18:08Z',
 'fuel_type': 'diesel',
 'id': '9ac0f350-ed89-5582-a115-bbc19f07d87e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG02124',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 120800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'BMW 5er 530d GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Saving data for XG02124: {'auction_closing_time': 1774883888.0, 'created_time': 1773742002.722655, 'last_price_update_time': 1774848911.569988}
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG02124') HTTP/1.1" 204 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for AL45510: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for YH76604: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-30 05:35:11 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-30 05:35:11 [auto1.de] INFO: Scrape type for VX98591: 2
2026-03-30 05:35:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with identifier: VX98591
2026-03-30 05:35:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with scrape type 2
2026-03-30 05:35:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with scrape type 2
2026-03-30 05:35:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd26c9bf-b81c-5083-9bb1-d7ebb36c317f, identifier: VX98591
2026-03-30 05:35:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with identifier: VX98591
2026-03-30 05:35:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with identifier: VX98591
2026-03-30 05:35:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd26c9bf-b81c-5083-9bb1-d7ebb36c317f with identifier: VX98591 to the API
2026-03-30 05:35:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:13Z',
 'fuel_type': 'diesel',
 'id': 'fd26c9bf-b81c-5083-9bb1-d7ebb36c317f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX98591',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 183321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Saving data for VX98591: {'auction_closing_time': 1774884313.0, 'created_time': 1774550172.841786, 'last_price_update_time': 1774848912.166082}
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX98591') HTTP/1.1" 204 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for NG07529: 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for YY97857: 2
2026-03-30 05:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23347133-5437-5859-8091-1139d6db4a22 with identifier: YY97857
2026-03-30 05:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23347133-5437-5859-8091-1139d6db4a22 with scrape type 2
2026-03-30 05:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23347133-5437-5859-8091-1139d6db4a22 with scrape type 2
2026-03-30 05:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23347133-5437-5859-8091-1139d6db4a22, identifier: YY97857
2026-03-30 05:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23347133-5437-5859-8091-1139d6db4a22 with identifier: YY97857
2026-03-30 05:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23347133-5437-5859-8091-1139d6db4a22 with identifier: YY97857
2026-03-30 05:35:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23347133-5437-5859-8091-1139d6db4a22 with identifier: YY97857 to the API
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:34:13Z',
 'fuel_type': 'petrol',
 'id': '23347133-5437-5859-8091-1139d6db4a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY97857',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '25',
 'odometer': 225752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-30',
 'seller_name': None,
 'title': 'MG Rover 25 1.4 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2004}
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Saving data for YY97857: {'auction_closing_time': 1774884853.0, 'created_time': 1774637226.032457, 'last_price_update_time': 1774848912.689711}
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY97857') HTTP/1.1" 204 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for DS47068: 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 05:35:12 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-30 05:35:12 [auto1.de] INFO: Scrape type for LC77842: 2
2026-03-30 05:35:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e9c06c-0743-5aa1-8868-5d36adb13076 with identifier: LC77842
2026-03-30 05:35:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e9c06c-0743-5aa1-8868-5d36adb13076 with scrape type 2
2026-03-30 05:35:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22e9c06c-0743-5aa1-8868-5d36adb13076 with scrape type 2
2026-03-30 05:35:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22e9c06c-0743-5aa1-8868-5d36adb13076, identifier: LC77842
2026-03-30 05:35:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22e9c06c-0743-5aa1-8868-5d36adb13076 with identifier: LC77842
2026-03-30 05:35:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22e9c06c-0743-5aa1-8868-5d36adb13076 with identifier: LC77842
2026-03-30 05:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22e9c06c-0743-5aa1-8868-5d36adb13076 with identifier: LC77842 to the API
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:03:34Z',
 'fuel_type': 'diesel',
 'id': '22e9c06c-0743-5aa1-8868-5d36adb13076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC77842',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 187774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-30 05:35:13 [auto1.de] INFO: Saving data for LC77842: {'auction_closing_time': 1774883014.0, 'created_time': 1773685969.872332, 'last_price_update_time': 1774848913.226551}
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC77842') HTTP/1.1" 204 0
2026-03-30 05:35:13 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-30 05:35:13 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-30 05:35:13 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-30 05:35:13 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-30 05:35:13 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-30 05:35:13 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-30 05:35:13 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-30 05:35:13 [auto1.de] INFO: Scrape type for TE35535: 2
2026-03-30 05:35:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496614f6-24f6-5d63-b032-d465a5daf231 with identifier: TE35535
2026-03-30 05:35:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496614f6-24f6-5d63-b032-d465a5daf231 with scrape type 2
2026-03-30 05:35:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 496614f6-24f6-5d63-b032-d465a5daf231 with scrape type 2
2026-03-30 05:35:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 496614f6-24f6-5d63-b032-d465a5daf231, identifier: TE35535
2026-03-30 05:35:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 496614f6-24f6-5d63-b032-d465a5daf231 with identifier: TE35535
2026-03-30 05:35:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 496614f6-24f6-5d63-b032-d465a5daf231 with identifier: TE35535
2026-03-30 05:35:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 496614f6-24f6-5d63-b032-d465a5daf231 with identifier: TE35535 to the API
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:23:59Z',
 'fuel_type': 'petrol',
 'id': '496614f6-24f6-5d63-b032-d465a5daf231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE35535',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 152251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-30 05:35:13 [auto1.de] INFO: Saving data for TE35535: {'auction_closing_time': 1774884239.0, 'created_time': 1773229787.960925, 'last_price_update_time': 1774848913.77503}
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE35535') HTTP/1.1" 204 0
2026-03-30 05:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:14 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for RK13717: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for SX08499: 2
2026-03-30 05:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with identifier: SX08499
2026-03-30 05:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with scrape type 2
2026-03-30 05:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with scrape type 2
2026-03-30 05:35:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3dba1b3-311c-58d8-b26c-9f8f46bc65e0, identifier: SX08499
2026-03-30 05:35:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with identifier: SX08499
2026-03-30 05:35:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with identifier: SX08499
2026-03-30 05:35:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3dba1b3-311c-58d8-b26c-9f8f46bc65e0 with identifier: SX08499 to the API
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'petrol',
 'id': 'c3dba1b3-311c-58d8-b26c-9f8f46bc65e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX08499',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 143909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Saving data for SX08499: {'auction_closing_time': 1774886196.0, 'created_time': 1774639142.767617, 'last_price_update_time': 1774848914.801248}
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX08499') HTTP/1.1" 204 0
2026-03-30 05:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for TU73668: 0
2026-03-30 05:35:14 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-30 05:35:14 [auto1.de] INFO: Scrape type for TR96368: 2
2026-03-30 05:35:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with identifier: TR96368
2026-03-30 05:35:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with scrape type 2
2026-03-30 05:35:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with scrape type 2
2026-03-30 05:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6, identifier: TR96368
2026-03-30 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with identifier: TR96368
2026-03-30 05:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with identifier: TR96368
2026-03-30 05:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6 with identifier: TR96368 to the API
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:54:29Z',
 'fuel_type': 'diesel',
 'id': 'c90e67ef-76b3-52f1-a79e-7d4d78a2d5f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR96368',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 170215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Saving data for TR96368: {'auction_closing_time': 1774886069.0, 'created_time': 1774639280.915213, 'last_price_update_time': 1774848915.319194}
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR96368') HTTP/1.1" 204 0
2026-03-30 05:35:15 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-30 05:35:15 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-30 05:35:15 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Scrape type for HM95018: 2
2026-03-30 05:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4436b6-985f-5507-816b-ff4213991135 with identifier: HM95018
2026-03-30 05:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4436b6-985f-5507-816b-ff4213991135 with scrape type 2
2026-03-30 05:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4436b6-985f-5507-816b-ff4213991135 with scrape type 2
2026-03-30 05:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4436b6-985f-5507-816b-ff4213991135, identifier: HM95018
2026-03-30 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4436b6-985f-5507-816b-ff4213991135 with identifier: HM95018
2026-03-30 05:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4436b6-985f-5507-816b-ff4213991135 with identifier: HM95018
2026-03-30 05:35:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4436b6-985f-5507-816b-ff4213991135 with identifier: HM95018 to the API
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:29:35Z',
 'fuel_type': 'petrol',
 'id': '1d4436b6-985f-5507-816b-ff4213991135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM95018',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 160698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-25',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Saving data for HM95018: {'auction_closing_time': 1774884575.0, 'created_time': 1774636800.771167, 'last_price_update_time': 1774848915.753167}
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM95018') HTTP/1.1" 204 0
2026-03-30 05:35:15 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-30 05:35:15 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-30 05:35:15 [auto1.de] INFO: Scrape type for JR56038: 2
2026-03-30 05:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47bb0fe2-c44a-57a9-ad69-f065d090e445 with identifier: JR56038
2026-03-30 05:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47bb0fe2-c44a-57a9-ad69-f065d090e445 with scrape type 2
2026-03-30 05:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47bb0fe2-c44a-57a9-ad69-f065d090e445 with scrape type 2
2026-03-30 05:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47bb0fe2-c44a-57a9-ad69-f065d090e445, identifier: JR56038
2026-03-30 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47bb0fe2-c44a-57a9-ad69-f065d090e445 with identifier: JR56038
2026-03-30 05:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47bb0fe2-c44a-57a9-ad69-f065d090e445 with identifier: JR56038
2026-03-30 05:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47bb0fe2-c44a-57a9-ad69-f065d090e445 with identifier: JR56038 to the API
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:45Z',
 'fuel_type': 'diesel',
 'id': '47bb0fe2-c44a-57a9-ad69-f065d090e445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR56038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 217442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-21',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2016}
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Saving data for JR56038: {'auction_closing_time': 1774884045.0, 'created_time': 1774636883.11984, 'last_price_update_time': 1774848916.241065}
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR56038') HTTP/1.1" 204 0
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Scrape type for MX37752: 2
2026-03-30 05:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102f4e26-7c8c-51fe-bc92-85338411382a with identifier: MX37752
2026-03-30 05:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102f4e26-7c8c-51fe-bc92-85338411382a with scrape type 2
2026-03-30 05:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102f4e26-7c8c-51fe-bc92-85338411382a with scrape type 2
2026-03-30 05:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 102f4e26-7c8c-51fe-bc92-85338411382a, identifier: MX37752
2026-03-30 05:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 102f4e26-7c8c-51fe-bc92-85338411382a with identifier: MX37752
2026-03-30 05:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 102f4e26-7c8c-51fe-bc92-85338411382a with identifier: MX37752
2026-03-30 05:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 102f4e26-7c8c-51fe-bc92-85338411382a with identifier: MX37752 to the API
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:37:53Z',
 'fuel_type': 'petrol',
 'id': '102f4e26-7c8c-51fe-bc92-85338411382a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX37752',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 79222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Saving data for MX37752: {'auction_closing_time': 1774885073.0, 'created_time': 1774636600.780761, 'last_price_update_time': 1774848916.72976}
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX37752') HTTP/1.1" 204 0
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 05:35:16 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-30 05:35:16 [auto1.de] INFO: Scrape type for LK79875: 0
2026-03-30 05:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:17 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:17 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-30 05:35:17 [auto1.de] INFO: Scrape type for AG47249: 0
2026-03-30 05:35:17 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-30 05:35:17 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-30 05:35:17 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-30 05:35:17 [auto1.de] INFO: Scrape type for LK34875: 2
2026-03-30 05:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea05f891-a722-516e-bec0-d51e39839554 with identifier: LK34875
2026-03-30 05:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea05f891-a722-516e-bec0-d51e39839554 with scrape type 2
2026-03-30 05:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea05f891-a722-516e-bec0-d51e39839554 with scrape type 2
2026-03-30 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea05f891-a722-516e-bec0-d51e39839554, identifier: LK34875
2026-03-30 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea05f891-a722-516e-bec0-d51e39839554 with identifier: LK34875
2026-03-30 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea05f891-a722-516e-bec0-d51e39839554 with identifier: LK34875
2026-03-30 05:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea05f891-a722-516e-bec0-d51e39839554 with identifier: LK34875 to the API
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': 'ea05f891-a722-516e-bec0-d51e39839554',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK34875',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 40707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-30 05:35:18 [auto1.de] INFO: Saving data for LK34875: {'auction_closing_time': 1774885164.0, 'created_time': 1774636483.561232, 'last_price_update_time': 1774848918.291733}
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK34875') HTTP/1.1" 204 0
2026-03-30 05:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:18 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-30 05:35:18 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-30 05:35:18 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 05:35:18 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-30 05:35:18 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-30 05:35:18 [auto1.de] INFO: Scrape type for EY55649: 2
2026-03-30 05:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c78f899b-6337-5c1f-8133-6f292b2f78df with identifier: EY55649
2026-03-30 05:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c78f899b-6337-5c1f-8133-6f292b2f78df with scrape type 2
2026-03-30 05:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c78f899b-6337-5c1f-8133-6f292b2f78df with scrape type 2
2026-03-30 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c78f899b-6337-5c1f-8133-6f292b2f78df, identifier: EY55649
2026-03-30 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c78f899b-6337-5c1f-8133-6f292b2f78df with identifier: EY55649
2026-03-30 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c78f899b-6337-5c1f-8133-6f292b2f78df with identifier: EY55649
2026-03-30 05:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c78f899b-6337-5c1f-8133-6f292b2f78df with identifier: EY55649 to the API
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:44Z',
 'fuel_type': 'petrol',
 'id': 'c78f899b-6337-5c1f-8133-6f292b2f78df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY55649',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 15179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-04',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2023}
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-30 05:35:18 [auto1.de] INFO: Saving data for EY55649: {'auction_closing_time': 1774885604.0, 'created_time': 1773660764.523279, 'last_price_update_time': 1774848918.723313}
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY55649') HTTP/1.1" 204 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for ER51376: 2
2026-03-30 05:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff1df9ac-9757-5bbc-89fe-69efeced9789 with identifier: ER51376
2026-03-30 05:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff1df9ac-9757-5bbc-89fe-69efeced9789 with scrape type 2
2026-03-30 05:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff1df9ac-9757-5bbc-89fe-69efeced9789 with scrape type 2
2026-03-30 05:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff1df9ac-9757-5bbc-89fe-69efeced9789, identifier: ER51376
2026-03-30 05:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff1df9ac-9757-5bbc-89fe-69efeced9789 with identifier: ER51376
2026-03-30 05:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff1df9ac-9757-5bbc-89fe-69efeced9789 with identifier: ER51376
2026-03-30 05:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff1df9ac-9757-5bbc-89fe-69efeced9789 with identifier: ER51376 to the API
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:50Z',
 'fuel_type': 'diesel',
 'id': 'ff1df9ac-9757-5bbc-89fe-69efeced9789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER51376',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 144849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-09',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.5 DI-D Intense Doppelkabine 4WD',
 'transmission': 'manual',
 'trim': 'Intense Doppelkabine 4WD',
 'year': 2008}
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Saving data for ER51376: {'auction_closing_time': 1774883990.0, 'created_time': 1774636385.779006, 'last_price_update_time': 1774848919.4454}
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER51376') HTTP/1.1" 204 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for RR35143: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-30 05:35:19 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Scrape type for SK20956: 2
2026-03-30 05:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8508109a-941d-5d4b-ba1f-25af5a895532 with identifier: SK20956
2026-03-30 05:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8508109a-941d-5d4b-ba1f-25af5a895532 with scrape type 2
2026-03-30 05:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8508109a-941d-5d4b-ba1f-25af5a895532 with scrape type 2
2026-03-30 05:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8508109a-941d-5d4b-ba1f-25af5a895532, identifier: SK20956
2026-03-30 05:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8508109a-941d-5d4b-ba1f-25af5a895532 with identifier: SK20956
2026-03-30 05:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8508109a-941d-5d4b-ba1f-25af5a895532 with identifier: SK20956
2026-03-30 05:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8508109a-941d-5d4b-ba1f-25af5a895532 with identifier: SK20956 to the API
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'petrol',
 'id': '8508109a-941d-5d4b-ba1f-25af5a895532',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK20956',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 200563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-30 05:35:19 [auto1.de] INFO: Saving data for SK20956: {'auction_closing_time': 1774882804.0, 'created_time': 1774636519.263997, 'last_price_update_time': 1774848919.952459}
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK20956') HTTP/1.1" 204 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for SA39123: 2
2026-03-30 05:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with identifier: SA39123
2026-03-30 05:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with scrape type 2
2026-03-30 05:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with scrape type 2
2026-03-30 05:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ccb41aa-a319-5adf-9164-0ae1fb143bbc, identifier: SA39123
2026-03-30 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with identifier: SA39123
2026-03-30 05:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with identifier: SA39123
2026-03-30 05:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ccb41aa-a319-5adf-9164-0ae1fb143bbc with identifier: SA39123 to the API
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:38Z',
 'fuel_type': 'petrol',
 'id': '4ccb41aa-a319-5adf-9164-0ae1fb143bbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA39123',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 120563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Saving data for SA39123: {'auction_closing_time': 1774883318.0, 'created_time': 1774637612.368572, 'last_price_update_time': 1774848920.461754}
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA39123') HTTP/1.1" 204 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for AB40080: 2
2026-03-30 05:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4108d14c-acc3-50d2-94d7-f583643770b6 with identifier: AB40080
2026-03-30 05:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4108d14c-acc3-50d2-94d7-f583643770b6 with scrape type 2
2026-03-30 05:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4108d14c-acc3-50d2-94d7-f583643770b6 with scrape type 2
2026-03-30 05:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4108d14c-acc3-50d2-94d7-f583643770b6, identifier: AB40080
2026-03-30 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4108d14c-acc3-50d2-94d7-f583643770b6 with identifier: AB40080
2026-03-30 05:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4108d14c-acc3-50d2-94d7-f583643770b6 with identifier: AB40080
2026-03-30 05:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4108d14c-acc3-50d2-94d7-f583643770b6 with identifier: AB40080 to the API
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:42Z',
 'fuel_type': 'diesel',
 'id': '4108d14c-acc3-50d2-94d7-f583643770b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB40080',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '807',
 'odometer': 212349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-06',
 'seller_name': None,
 'title': 'Peugeot 807 2.0 HDi Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2006}
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Saving data for AB40080: {'auction_closing_time': 1774885362.0, 'created_time': 1774638800.508724, 'last_price_update_time': 1774848920.879446}
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB40080') HTTP/1.1" 204 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-30 05:35:20 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 05:35:20 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 05:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:21 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:21 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-30 05:35:21 [auto1.de] INFO: Scrape type for YJ47160: 2
2026-03-30 05:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c1b9bc-8720-5118-ba33-2e018810bf85 with identifier: YJ47160
2026-03-30 05:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c1b9bc-8720-5118-ba33-2e018810bf85 with scrape type 2
2026-03-30 05:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c1b9bc-8720-5118-ba33-2e018810bf85 with scrape type 2
2026-03-30 05:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3c1b9bc-8720-5118-ba33-2e018810bf85, identifier: YJ47160
2026-03-30 05:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3c1b9bc-8720-5118-ba33-2e018810bf85 with identifier: YJ47160
2026-03-30 05:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3c1b9bc-8720-5118-ba33-2e018810bf85 with identifier: YJ47160
2026-03-30 05:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3c1b9bc-8720-5118-ba33-2e018810bf85 with identifier: YJ47160 to the API
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:15:50Z',
 'fuel_type': 'petrol',
 'id': 'b3c1b9bc-8720-5118-ba33-2e018810bf85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ47160',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 64728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2016}
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-30 05:35:21 [auto1.de] INFO: Saving data for YJ47160: {'auction_closing_time': 1774883750.0, 'created_time': 1774639446.842119, 'last_price_update_time': 1774848921.683514}
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ47160') HTTP/1.1" 204 0
2026-03-30 05:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:21 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 05:35:21 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-30 05:35:21 [auto1.de] INFO: Scrape type for UG40068: 2
2026-03-30 05:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c62a182-88a0-580b-a1d9-da9085cdbedb with identifier: UG40068
2026-03-30 05:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c62a182-88a0-580b-a1d9-da9085cdbedb with scrape type 2
2026-03-30 05:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c62a182-88a0-580b-a1d9-da9085cdbedb with scrape type 2
2026-03-30 05:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c62a182-88a0-580b-a1d9-da9085cdbedb, identifier: UG40068
2026-03-30 05:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c62a182-88a0-580b-a1d9-da9085cdbedb with identifier: UG40068
2026-03-30 05:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c62a182-88a0-580b-a1d9-da9085cdbedb with identifier: UG40068
2026-03-30 05:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c62a182-88a0-580b-a1d9-da9085cdbedb with identifier: UG40068 to the API
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:28Z',
 'fuel_type': 'petrol',
 'id': '4c62a182-88a0-580b-a1d9-da9085cdbedb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG40068',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 115838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI ACT SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2018}
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Saving data for UG40068: {'auction_closing_time': 1774884328.0, 'created_time': 1774637243.08957, 'last_price_update_time': 1774848922.218837}
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG40068') HTTP/1.1" 204 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for MR73293: 2
2026-03-30 05:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e61b51-4832-5eb1-b200-b79f92fb98c7 with identifier: MR73293
2026-03-30 05:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e61b51-4832-5eb1-b200-b79f92fb98c7 with scrape type 2
2026-03-30 05:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e61b51-4832-5eb1-b200-b79f92fb98c7 with scrape type 2
2026-03-30 05:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e61b51-4832-5eb1-b200-b79f92fb98c7, identifier: MR73293
2026-03-30 05:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e61b51-4832-5eb1-b200-b79f92fb98c7 with identifier: MR73293
2026-03-30 05:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e61b51-4832-5eb1-b200-b79f92fb98c7 with identifier: MR73293
2026-03-30 05:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e61b51-4832-5eb1-b200-b79f92fb98c7 with identifier: MR73293 to the API
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:55:05Z',
 'fuel_type': 'petrol',
 'id': '28e61b51-4832-5eb1-b200-b79f92fb98c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR73293',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 144649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-05',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2011}
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Saving data for MR73293: {'auction_closing_time': 1774886105.0, 'created_time': 1774550442.413309, 'last_price_update_time': 1774848922.651509}
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR73293') HTTP/1.1" 204 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for NR99017: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-30 05:35:22 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-30 05:35:22 [auto1.de] INFO: Scrape type for WM19192: 2
2026-03-30 05:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 809df8fa-6d5b-5cad-b392-5151b47391a0 with identifier: WM19192
2026-03-30 05:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 809df8fa-6d5b-5cad-b392-5151b47391a0 with scrape type 2
2026-03-30 05:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 809df8fa-6d5b-5cad-b392-5151b47391a0 with scrape type 2
2026-03-30 05:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 809df8fa-6d5b-5cad-b392-5151b47391a0, identifier: WM19192
2026-03-30 05:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 809df8fa-6d5b-5cad-b392-5151b47391a0 with identifier: WM19192
2026-03-30 05:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 809df8fa-6d5b-5cad-b392-5151b47391a0 with identifier: WM19192
2026-03-30 05:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 809df8fa-6d5b-5cad-b392-5151b47391a0 with identifier: WM19192 to the API
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:26:15Z',
 'fuel_type': 'petrol',
 'id': '809df8fa-6d5b-5cad-b392-5151b47391a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM19192',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 328605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2013}
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Saving data for WM19192: {'auction_closing_time': 1774884375.0, 'created_time': 1774638416.860275, 'last_price_update_time': 1774848923.200209}
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM19192') HTTP/1.1" 204 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for BC97155: 2
2026-03-30 05:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b07130c0-527a-5eb4-a539-5ab4caf30283 with identifier: BC97155
2026-03-30 05:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b07130c0-527a-5eb4-a539-5ab4caf30283 with scrape type 2
2026-03-30 05:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b07130c0-527a-5eb4-a539-5ab4caf30283 with scrape type 2
2026-03-30 05:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b07130c0-527a-5eb4-a539-5ab4caf30283, identifier: BC97155
2026-03-30 05:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b07130c0-527a-5eb4-a539-5ab4caf30283 with identifier: BC97155
2026-03-30 05:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b07130c0-527a-5eb4-a539-5ab4caf30283 with identifier: BC97155
2026-03-30 05:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b07130c0-527a-5eb4-a539-5ab4caf30283 with identifier: BC97155 to the API
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:17Z',
 'fuel_type': 'petrol',
 'id': 'b07130c0-527a-5eb4-a539-5ab4caf30283',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC97155',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler',
 'odometer': 203689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-03-27',
 'seller_name': None,
 'title': 'Jeep Wrangler 2.5',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Saving data for BC97155: {'auction_closing_time': 1774884917.0, 'created_time': 1773343442.167712, 'last_price_update_time': 1774848923.685496}
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC97155') HTTP/1.1" 204 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for VT68593: 0
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-30 05:35:23 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-30 05:35:23 [auto1.de] INFO: Scrape type for UM92745: 2
2026-03-30 05:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with identifier: UM92745
2026-03-30 05:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with scrape type 2
2026-03-30 05:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with scrape type 2
2026-03-30 05:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5441ae9-7df8-5824-b04c-5c2d27dcbd92, identifier: UM92745
2026-03-30 05:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with identifier: UM92745
2026-03-30 05:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with identifier: UM92745
2026-03-30 05:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5441ae9-7df8-5824-b04c-5c2d27dcbd92 with identifier: UM92745 to the API
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 550,
 'expiration_date': '2026-03-30T15:27:12Z',
 'fuel_type': 'petrol',
 'id': 'c5441ae9-7df8-5824-b04c-5c2d27dcbd92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM92745',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 65859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 5.0 V8 SVR',
 'transmission': 'automatic',
 'trim': 'SVR',
 'year': 2018}
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Saving data for UM92745: {'auction_closing_time': 1774884432.0, 'created_time': 1773830841.222437, 'last_price_update_time': 1774848924.195956}
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM92745') HTTP/1.1" 204 0
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Scrape type for JF43262: 2
2026-03-30 05:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with identifier: JF43262
2026-03-30 05:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with scrape type 2
2026-03-30 05:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with scrape type 2
2026-03-30 05:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad, identifier: JF43262
2026-03-30 05:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with identifier: JF43262
2026-03-30 05:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with identifier: JF43262
2026-03-30 05:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad with identifier: JF43262 to the API
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:27:26Z',
 'fuel_type': 'diesel',
 'id': 'a6b64825-c2db-54b7-92f7-ffb3bcaeb6ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF43262',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-3',
 'odometer': 279103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-19',
 'seller_name': None,
 'title': 'Saab 9-3 1.9 TTiD Vector',
 'transmission': 'manual',
 'trim': 'Vector',
 'year': 2010}
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Saving data for JF43262: {'auction_closing_time': 1774884446.0, 'created_time': 1774521836.96465, 'last_price_update_time': 1774848924.637117}
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF43262') HTTP/1.1" 204 0
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 05:35:24 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-30 05:35:24 [auto1.de] INFO: Scrape type for TL65156: 2
2026-03-30 05:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20798140-3050-56b9-814c-bb1bffd7927e with identifier: TL65156
2026-03-30 05:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20798140-3050-56b9-814c-bb1bffd7927e with scrape type 2
2026-03-30 05:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20798140-3050-56b9-814c-bb1bffd7927e with scrape type 2
2026-03-30 05:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20798140-3050-56b9-814c-bb1bffd7927e, identifier: TL65156
2026-03-30 05:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20798140-3050-56b9-814c-bb1bffd7927e with identifier: TL65156
2026-03-30 05:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20798140-3050-56b9-814c-bb1bffd7927e with identifier: TL65156
2026-03-30 05:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20798140-3050-56b9-814c-bb1bffd7927e with identifier: TL65156 to the API
2026-03-30 05:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:23Z',
 'fuel_type': 'petrol',
 'id': '20798140-3050-56b9-814c-bb1bffd7927e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL65156',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 160170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Saving data for TL65156: {'auction_closing_time': 1774884203.0, 'created_time': 1774639488.594222, 'last_price_update_time': 1774848925.13574}
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL65156') HTTP/1.1" 204 0
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Scrape type for KN67174: 0
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Scrape type for CK84470: 2
2026-03-30 05:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de2d7712-c702-5f86-962a-4c18e8faa663 with identifier: CK84470
2026-03-30 05:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de2d7712-c702-5f86-962a-4c18e8faa663 with scrape type 2
2026-03-30 05:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de2d7712-c702-5f86-962a-4c18e8faa663 with scrape type 2
2026-03-30 05:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de2d7712-c702-5f86-962a-4c18e8faa663, identifier: CK84470
2026-03-30 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de2d7712-c702-5f86-962a-4c18e8faa663 with identifier: CK84470
2026-03-30 05:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de2d7712-c702-5f86-962a-4c18e8faa663 with identifier: CK84470
2026-03-30 05:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de2d7712-c702-5f86-962a-4c18e8faa663 with identifier: CK84470 to the API
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:32Z',
 'fuel_type': 'petrol',
 'id': 'de2d7712-c702-5f86-962a-4c18e8faa663',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK84470',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 97948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-24',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2010}
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Saving data for CK84470: {'auction_closing_time': 1774885532.0, 'created_time': 1774637417.683643, 'last_price_update_time': 1774848925.568118}
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK84470') HTTP/1.1" 204 0
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 05:35:25 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Scrape type for NE62435: 2
2026-03-30 05:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-30 05:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with scrape type 2
2026-03-30 05:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with scrape type 2
2026-03-30 05:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3, identifier: NE62435
2026-03-30 05:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-30 05:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435
2026-03-30 05:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 915c1b0d-1b89-5ee6-9f1e-3794bbe57da3 with identifier: NE62435 to the API
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-30T15:01:37Z',
 'fuel_type': 'petrol',
 'id': '915c1b0d-1b89-5ee6-9f1e-3794bbe57da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE62435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 180312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-01',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-30 05:35:25 [auto1.de] INFO: Saving data for NE62435: {'auction_closing_time': 1774882897.0, 'created_time': 1774552430.430519, 'last_price_update_time': 1774848925.993674}
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE62435') HTTP/1.1" 204 0
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-30 05:35:26 [auto1.de] INFO: Scrape type for WP12836: 0
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-30 05:35:26 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 05:35:26 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-30 05:35:26 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-30 05:35:26 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-30 05:35:26 [auto1.de] INFO: Scrape type for UA60360: 2
2026-03-30 05:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-30 05:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f030181-8011-507a-b598-f751118fcc3f with scrape type 2
2026-03-30 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f030181-8011-507a-b598-f751118fcc3f with scrape type 2
2026-03-30 05:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f030181-8011-507a-b598-f751118fcc3f, identifier: UA60360
2026-03-30 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-30 05:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360
2026-03-30 05:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f030181-8011-507a-b598-f751118fcc3f with identifier: UA60360 to the API
2026-03-30 05:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:04Z',
 'fuel_type': 'diesel',
 'id': '6f030181-8011-507a-b598-f751118fcc3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA60360',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 328788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-09',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Saving data for UA60360: {'auction_closing_time': 1774885084.0, 'created_time': 1774551666.89731, 'last_price_update_time': 1774848927.196254}
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA60360') HTTP/1.1" 204 0
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Scrape type for JB50627: 0
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Scrape type for PW80627: 2
2026-03-30 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9474982a-7464-58e4-bc10-a19817b38895 with identifier: PW80627
2026-03-30 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9474982a-7464-58e4-bc10-a19817b38895 with scrape type 2
2026-03-30 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9474982a-7464-58e4-bc10-a19817b38895 with scrape type 2
2026-03-30 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9474982a-7464-58e4-bc10-a19817b38895, identifier: PW80627
2026-03-30 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9474982a-7464-58e4-bc10-a19817b38895 with identifier: PW80627
2026-03-30 05:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9474982a-7464-58e4-bc10-a19817b38895 with identifier: PW80627
2026-03-30 05:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9474982a-7464-58e4-bc10-a19817b38895 with identifier: PW80627 to the API
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'petrol',
 'id': '9474982a-7464-58e4-bc10-a19817b38895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW80627',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 131923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-16',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2007}
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Saving data for PW80627: {'auction_closing_time': 1774885735.0, 'created_time': 1774637281.761429, 'last_price_update_time': 1774848927.804774}
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW80627') HTTP/1.1" 204 0
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 05:35:27 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-30 05:35:27 [auto1.de] INFO: Scrape type for HR10562: 2
2026-03-30 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b823e665-75bf-5ec5-b384-488a4074557f with identifier: HR10562
2026-03-30 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b823e665-75bf-5ec5-b384-488a4074557f with scrape type 2
2026-03-30 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b823e665-75bf-5ec5-b384-488a4074557f with scrape type 2
2026-03-30 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b823e665-75bf-5ec5-b384-488a4074557f, identifier: HR10562
2026-03-30 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b823e665-75bf-5ec5-b384-488a4074557f with identifier: HR10562
2026-03-30 05:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b823e665-75bf-5ec5-b384-488a4074557f with identifier: HR10562
2026-03-30 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b823e665-75bf-5ec5-b384-488a4074557f with identifier: HR10562 to the API
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:38Z',
 'fuel_type': 'petrol',
 'id': 'b823e665-75bf-5ec5-b384-488a4074557f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR10562',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 100365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-30 05:35:28 [auto1.de] INFO: Saving data for HR10562: {'auction_closing_time': 1774883018.0, 'created_time': 1773427503.086074, 'last_price_update_time': 1774848928.237132}
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR10562') HTTP/1.1" 204 0
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-30 05:35:28 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-30 05:35:28 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-30 05:35:28 [auto1.de] INFO: Scrape type for RN12872: 2
2026-03-30 05:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13b1cd0-451c-55b3-ad06-114a2cec9cca with identifier: RN12872
2026-03-30 05:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13b1cd0-451c-55b3-ad06-114a2cec9cca with scrape type 2
2026-03-30 05:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a13b1cd0-451c-55b3-ad06-114a2cec9cca with scrape type 2
2026-03-30 05:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a13b1cd0-451c-55b3-ad06-114a2cec9cca, identifier: RN12872
2026-03-30 05:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a13b1cd0-451c-55b3-ad06-114a2cec9cca with identifier: RN12872
2026-03-30 05:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a13b1cd0-451c-55b3-ad06-114a2cec9cca with identifier: RN12872
2026-03-30 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a13b1cd0-451c-55b3-ad06-114a2cec9cca with identifier: RN12872 to the API
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:45:03Z',
 'fuel_type': 'petrol',
 'id': 'a13b1cd0-451c-55b3-ad06-114a2cec9cca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN12872',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 59111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'BMW 2er 220i Gran Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-30 05:35:28 [auto1.de] INFO: Saving data for RN12872: {'auction_closing_time': 1774885503.0, 'created_time': 1774639221.586314, 'last_price_update_time': 1774848928.888538}
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN12872') HTTP/1.1" 204 0
2026-03-30 05:35:28 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for NP24686: 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for CD45301: 2
2026-03-30 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with identifier: CD45301
2026-03-30 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with scrape type 2
2026-03-30 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with scrape type 2
2026-03-30 05:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b, identifier: CD45301
2026-03-30 05:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with identifier: CD45301
2026-03-30 05:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with identifier: CD45301
2026-03-30 05:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b with identifier: CD45301 to the API
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:03:09Z',
 'fuel_type': 'hybrid',
 'id': '886d37dc-4fe6-5f5a-8d5e-3d2dfbf25e5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD45301',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 51738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-18',
 'seller_name': None,
 'title': 'Audi A6 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2021}
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Saving data for CD45301: {'auction_closing_time': 1774882989.0, 'created_time': 1773917328.072548, 'last_price_update_time': 1774848929.48295}
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD45301') HTTP/1.1" 204 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for WM90118: 2
2026-03-30 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08cd6973-8d47-5deb-b817-830675f3f8b8 with identifier: WM90118
2026-03-30 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08cd6973-8d47-5deb-b817-830675f3f8b8 with scrape type 2
2026-03-30 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08cd6973-8d47-5deb-b817-830675f3f8b8 with scrape type 2
2026-03-30 05:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08cd6973-8d47-5deb-b817-830675f3f8b8, identifier: WM90118
2026-03-30 05:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08cd6973-8d47-5deb-b817-830675f3f8b8 with identifier: WM90118
2026-03-30 05:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08cd6973-8d47-5deb-b817-830675f3f8b8 with identifier: WM90118
2026-03-30 05:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08cd6973-8d47-5deb-b817-830675f3f8b8 with identifier: WM90118 to the API
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:49Z',
 'fuel_type': 'petrol',
 'id': '08cd6973-8d47-5deb-b817-830675f3f8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM90118',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 226960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-15',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2017}
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Saving data for WM90118: {'auction_closing_time': 1774885969.0, 'created_time': 1774639224.125936, 'last_price_update_time': 1774848929.903969}
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM90118') HTTP/1.1" 204 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for AA40394: 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for XN62659: 0
2026-03-30 05:35:29 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 05:35:29 [auto1.de] INFO: Scrape type for CK58457: 2
2026-03-30 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with identifier: CK58457
2026-03-30 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with scrape type 2
2026-03-30 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with scrape type 2
2026-03-30 05:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fb0b0de-d6cb-58de-ab17-d2d3461877aa, identifier: CK58457
2026-03-30 05:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with identifier: CK58457
2026-03-30 05:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with identifier: CK58457
2026-03-30 05:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fb0b0de-d6cb-58de-ab17-d2d3461877aa with identifier: CK58457 to the API
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:53Z',
 'fuel_type': 'diesel',
 'id': '5fb0b0de-d6cb-58de-ab17-d2d3461877aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK58457',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 76654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Saving data for CK58457: {'auction_closing_time': 1774884593.0, 'created_time': 1774550433.635185, 'last_price_update_time': 1774848930.370561}
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK58457') HTTP/1.1" 204 0
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Scrape type for AM35234: 0
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-30 05:35:30 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-30 05:35:30 [auto1.de] INFO: Scrape type for TX03008: 2
2026-03-30 05:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 448207b0-92da-5b8b-8f72-1f0f97691c45 with identifier: TX03008
2026-03-30 05:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448207b0-92da-5b8b-8f72-1f0f97691c45 with scrape type 2
2026-03-30 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 448207b0-92da-5b8b-8f72-1f0f97691c45 with scrape type 2
2026-03-30 05:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 448207b0-92da-5b8b-8f72-1f0f97691c45, identifier: TX03008
2026-03-30 05:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 448207b0-92da-5b8b-8f72-1f0f97691c45 with identifier: TX03008
2026-03-30 05:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 448207b0-92da-5b8b-8f72-1f0f97691c45 with identifier: TX03008
2026-03-30 05:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 448207b0-92da-5b8b-8f72-1f0f97691c45 with identifier: TX03008 to the API
2026-03-30 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-30T15:45:30Z',
 'fuel_type': 'petrol',
 'id': '448207b0-92da-5b8b-8f72-1f0f97691c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX03008',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 18222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2022}
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-30 05:35:31 [auto1.de] INFO: Saving data for TX03008: {'auction_closing_time': 1774885530.0, 'created_time': 1774639076.776463, 'last_price_update_time': 1774848931.703546}
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX03008') HTTP/1.1" 204 0
2026-03-30 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:31 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:31 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-30 05:35:31 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-30 05:35:31 [auto1.de] INFO: Scrape type for MC27977: 2
2026-03-30 05:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with identifier: MC27977
2026-03-30 05:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with scrape type 2
2026-03-30 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with scrape type 2
2026-03-30 05:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2, identifier: MC27977
2026-03-30 05:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with identifier: MC27977
2026-03-30 05:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with identifier: MC27977
2026-03-30 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2 with identifier: MC27977 to the API
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 385,
 'expiration_date': '2026-03-30T15:03:16Z',
 'fuel_type': 'diesel',
 'id': '2bd325f2-ca2d-5f9e-abaa-4050b33ba9a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC27977',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 374168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seller_name': None,
 'title': 'Porsche Cayenne S Diesel Platinum Edition',
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2017}
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-30 05:35:32 [auto1.de] INFO: Saving data for MC27977: {'auction_closing_time': 1774882996.0, 'created_time': 1774637386.816846, 'last_price_update_time': 1774848932.227797}
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC27977') HTTP/1.1" 204 0
2026-03-30 05:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:32 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-30 05:35:32 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-30 05:35:32 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-30 05:35:32 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-30 05:35:32 [auto1.de] INFO: Scrape type for AU22690: 2
2026-03-30 05:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-30 05:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with scrape type 2
2026-03-30 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with scrape type 2
2026-03-30 05:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c, identifier: AU22690
2026-03-30 05:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-30 05:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690
2026-03-30 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c with identifier: AU22690 to the API
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'petrol',
 'id': 'a07cc9b3-a0ce-59fe-9223-7e0a0202ac0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU22690',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 16215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seller_name': None,
 'title': 'Kia Stonic 1.2 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2023}
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-30 05:35:32 [auto1.de] INFO: Saving data for AU22690: {'auction_closing_time': 1774885106.0, 'created_time': 1774551864.532826, 'last_price_update_time': 1774848932.646977}
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU22690') HTTP/1.1" 204 0
2026-03-30 05:35:32 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-30 05:35:32 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-30 05:35:32 [auto1.de] INFO: Scrape type for DN57570: 2
2026-03-30 05:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f5b24c-d702-523f-8d40-385da473ea3e with identifier: DN57570
2026-03-30 05:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f5b24c-d702-523f-8d40-385da473ea3e with scrape type 2
2026-03-30 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f5b24c-d702-523f-8d40-385da473ea3e with scrape type 2
2026-03-30 05:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03f5b24c-d702-523f-8d40-385da473ea3e, identifier: DN57570
2026-03-30 05:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03f5b24c-d702-523f-8d40-385da473ea3e with identifier: DN57570
2026-03-30 05:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03f5b24c-d702-523f-8d40-385da473ea3e with identifier: DN57570
2026-03-30 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03f5b24c-d702-523f-8d40-385da473ea3e with identifier: DN57570 to the API
2026-03-30 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:50:24Z',
 'fuel_type': 'petrol',
 'id': '03f5b24c-d702-523f-8d40-385da473ea3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN57570',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 136067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active ecoFlex',
 'transmission': 'manual',
 'trim': 'Active ecoFlex',
 'year': 2017}
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Saving data for DN57570: {'auction_closing_time': 1774885824.0, 'created_time': 1774637960.975416, 'last_price_update_time': 1774848933.146285}
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN57570') HTTP/1.1" 204 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for RP88862: 2
2026-03-30 05:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-30 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with scrape type 2
2026-03-30 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with scrape type 2
2026-03-30 05:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32, identifier: RP88862
2026-03-30 05:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-30 05:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862
2026-03-30 05:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32 with identifier: RP88862 to the API
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:06:02Z',
 'fuel_type': 'petrol',
 'id': 'ab58d00d-6b4d-54cd-b3d5-bc01f2e5bb32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP88862',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 109654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Saving data for RP88862: {'auction_closing_time': 1774883162.0, 'created_time': 1774550645.415424, 'last_price_update_time': 1774848933.612627}
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP88862') HTTP/1.1" 204 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for ZT00838: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 05:35:33 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-30 05:35:33 [auto1.de] INFO: Scrape type for UR03591: 2
2026-03-30 05:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78851c4e-b7d7-50a0-baf0-c9da8806b268 with identifier: UR03591
2026-03-30 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78851c4e-b7d7-50a0-baf0-c9da8806b268 with scrape type 2
2026-03-30 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78851c4e-b7d7-50a0-baf0-c9da8806b268 with scrape type 2
2026-03-30 05:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78851c4e-b7d7-50a0-baf0-c9da8806b268, identifier: UR03591
2026-03-30 05:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78851c4e-b7d7-50a0-baf0-c9da8806b268 with identifier: UR03591
2026-03-30 05:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78851c4e-b7d7-50a0-baf0-c9da8806b268 with identifier: UR03591
2026-03-30 05:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78851c4e-b7d7-50a0-baf0-c9da8806b268 with identifier: UR03591 to the API
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:14Z',
 'fuel_type': 'diesel',
 'id': '78851c4e-b7d7-50a0-baf0-c9da8806b268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR03591',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 195256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-30 05:35:34 [auto1.de] INFO: Saving data for UR03591: {'auction_closing_time': 1774886114.0, 'created_time': 1773429180.504231, 'last_price_update_time': 1774848934.09618}
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR03591') HTTP/1.1" 204 0
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-30 05:35:34 [auto1.de] INFO: Scrape type for HE80125: 2
2026-03-30 05:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with identifier: HE80125
2026-03-30 05:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with scrape type 2
2026-03-30 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with scrape type 2
2026-03-30 05:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a3771ab-fecf-5f9b-afd1-18b095ce03f3, identifier: HE80125
2026-03-30 05:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with identifier: HE80125
2026-03-30 05:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with identifier: HE80125
2026-03-30 05:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a3771ab-fecf-5f9b-afd1-18b095ce03f3 with identifier: HE80125 to the API
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'diesel',
 'id': '5a3771ab-fecf-5f9b-afd1-18b095ce03f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE80125',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 215493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-16',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-30 05:35:34 [auto1.de] INFO: Saving data for HE80125: {'auction_closing_time': 1774885180.0, 'created_time': 1774636774.887474, 'last_price_update_time': 1774848934.600082}
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE80125') HTTP/1.1" 204 0
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-30 05:35:34 [auto1.de] INFO: Scrape type for VL45063: 0
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 05:35:34 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-30 05:35:34 [auto1.de] INFO: Scrape type for MU86214: 2
2026-03-30 05:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea7e350-adcb-509d-8f04-6a9cdf033993 with identifier: MU86214
2026-03-30 05:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea7e350-adcb-509d-8f04-6a9cdf033993 with scrape type 2
2026-03-30 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea7e350-adcb-509d-8f04-6a9cdf033993 with scrape type 2
2026-03-30 05:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dea7e350-adcb-509d-8f04-6a9cdf033993, identifier: MU86214
2026-03-30 05:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dea7e350-adcb-509d-8f04-6a9cdf033993 with identifier: MU86214
2026-03-30 05:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dea7e350-adcb-509d-8f04-6a9cdf033993 with identifier: MU86214
2026-03-30 05:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dea7e350-adcb-509d-8f04-6a9cdf033993 with identifier: MU86214 to the API
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:39Z',
 'fuel_type': 'diesel',
 'id': 'dea7e350-adcb-509d-8f04-6a9cdf033993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU86214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 233784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-30 05:35:35 [auto1.de] INFO: Saving data for MU86214: {'auction_closing_time': 1774884159.0, 'created_time': 1774350124.771025, 'last_price_update_time': 1774848935.020282}
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU86214') HTTP/1.1" 204 0
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-30 05:35:35 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-30 05:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:35 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-30 05:35:35 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-30 05:35:35 [auto1.de] INFO: Scrape type for SZ45065: 2
2026-03-30 05:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with identifier: SZ45065
2026-03-30 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with scrape type 2
2026-03-30 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with scrape type 2
2026-03-30 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26919a9c-085a-5ef7-be07-6f20e85fc8f6, identifier: SZ45065
2026-03-30 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with identifier: SZ45065
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with identifier: SZ45065
2026-03-30 05:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26919a9c-085a-5ef7-be07-6f20e85fc8f6 with identifier: SZ45065 to the API
2026-03-30 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'electro',
 'id': '26919a9c-085a-5ef7-be07-6f20e85fc8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ45065',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 84167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-10',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Saving data for SZ45065: {'auction_closing_time': 1774884068.0, 'created_time': 1774639154.747493, 'last_price_update_time': 1774848936.177761}
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ45065') HTTP/1.1" 204 0
2026-03-30 05:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:36 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Scrape type for DF33717: 0
2026-03-30 05:35:36 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-30 05:35:36 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-30 05:35:36 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Scrape type for PA19754: 2
2026-03-30 05:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1716dfee-015a-5137-909a-477e3bfaf4f0 with identifier: PA19754
2026-03-30 05:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1716dfee-015a-5137-909a-477e3bfaf4f0 with scrape type 2
2026-03-30 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1716dfee-015a-5137-909a-477e3bfaf4f0 with scrape type 2
2026-03-30 05:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1716dfee-015a-5137-909a-477e3bfaf4f0, identifier: PA19754
2026-03-30 05:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1716dfee-015a-5137-909a-477e3bfaf4f0 with identifier: PA19754
2026-03-30 05:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1716dfee-015a-5137-909a-477e3bfaf4f0 with identifier: PA19754
2026-03-30 05:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1716dfee-015a-5137-909a-477e3bfaf4f0 with identifier: PA19754 to the API
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:50:41Z',
 'fuel_type': 'petrol',
 'id': '1716dfee-015a-5137-909a-477e3bfaf4f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA19754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 168464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-15',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Saving data for PA19754: {'auction_closing_time': 1774885841.0, 'created_time': 1774636637.621218, 'last_price_update_time': 1774848936.699192}
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA19754') HTTP/1.1" 204 0
2026-03-30 05:35:36 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-30 05:35:36 [auto1.de] INFO: Scrape type for XR18256: 2
2026-03-30 05:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a95a98-532d-5c98-bf33-9562bdc70bb1 with identifier: XR18256
2026-03-30 05:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a95a98-532d-5c98-bf33-9562bdc70bb1 with scrape type 2
2026-03-30 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a95a98-532d-5c98-bf33-9562bdc70bb1 with scrape type 2
2026-03-30 05:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94a95a98-532d-5c98-bf33-9562bdc70bb1, identifier: XR18256
2026-03-30 05:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94a95a98-532d-5c98-bf33-9562bdc70bb1 with identifier: XR18256
2026-03-30 05:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94a95a98-532d-5c98-bf33-9562bdc70bb1 with identifier: XR18256
2026-03-30 05:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94a95a98-532d-5c98-bf33-9562bdc70bb1 with identifier: XR18256 to the API
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:26:04Z',
 'fuel_type': 'diesel',
 'id': '94a95a98-532d-5c98-bf33-9562bdc70bb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR18256',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 81364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Saving data for XR18256: {'auction_closing_time': 1774884364.0, 'created_time': 1774639287.9076, 'last_price_update_time': 1774848937.108166}
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR18256') HTTP/1.1" 204 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for MP68485: 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for WK90635: 2
2026-03-30 05:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-30 05:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with scrape type 2
2026-03-30 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with scrape type 2
2026-03-30 05:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5efb68dd-d6d6-5adc-b262-c13fa8c07432, identifier: WK90635
2026-03-30 05:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-30 05:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635
2026-03-30 05:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5efb68dd-d6d6-5adc-b262-c13fa8c07432 with identifier: WK90635 to the API
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:13:22Z',
 'fuel_type': 'petrol',
 'id': '5efb68dd-d6d6-5adc-b262-c13fa8c07432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK90635',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 72090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Saving data for WK90635: {'auction_closing_time': 1774883602.0, 'created_time': 1774552189.975449, 'last_price_update_time': 1774848937.578425}
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK90635') HTTP/1.1" 204 0
2026-03-30 05:35:37 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-30 05:35:37 [auto1.de] INFO: Scrape type for FC40686: 2
2026-03-30 05:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbcb2b27-9a2d-5137-9d37-e911806f1a66 with identifier: FC40686
2026-03-30 05:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbcb2b27-9a2d-5137-9d37-e911806f1a66 with scrape type 2
2026-03-30 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbcb2b27-9a2d-5137-9d37-e911806f1a66 with scrape type 2
2026-03-30 05:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbcb2b27-9a2d-5137-9d37-e911806f1a66, identifier: FC40686
2026-03-30 05:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbcb2b27-9a2d-5137-9d37-e911806f1a66 with identifier: FC40686
2026-03-30 05:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbcb2b27-9a2d-5137-9d37-e911806f1a66 with identifier: FC40686
2026-03-30 05:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbcb2b27-9a2d-5137-9d37-e911806f1a66 with identifier: FC40686 to the API
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:32:27Z',
 'fuel_type': 'diesel',
 'id': 'dbcb2b27-9a2d-5137-9d37-e911806f1a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC40686',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 181787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Diesel Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-30 05:35:38 [auto1.de] INFO: Saving data for FC40686: {'auction_closing_time': 1774884747.0, 'created_time': 1774549898.490125, 'last_price_update_time': 1774848938.092027}
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC40686') HTTP/1.1" 204 0
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: US02373
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-30 05:35:38 [auto1.de] INFO: Scrape type for US02373: 2
2026-03-30 05:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-30 05:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef963ded-ff2c-5818-b62e-a1e915283ebb with scrape type 2
2026-03-30 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef963ded-ff2c-5818-b62e-a1e915283ebb with scrape type 2
2026-03-30 05:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef963ded-ff2c-5818-b62e-a1e915283ebb, identifier: US02373
2026-03-30 05:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-30 05:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373
2026-03-30 05:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef963ded-ff2c-5818-b62e-a1e915283ebb with identifier: US02373 to the API
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'petrol',
 'id': 'ef963ded-ff2c-5818-b62e-a1e915283ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US02373',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 238715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-14',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-30 05:35:38 [auto1.de] INFO: Saving data for US02373: {'auction_closing_time': 1774883872.0, 'created_time': 1774550904.014831, 'last_price_update_time': 1774848938.508779}
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US02373') HTTP/1.1" 204 0
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-30 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:38 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-30 05:35:38 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-30 05:35:38 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for XY67074: 0
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for DP85983: 2
2026-03-30 05:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c81f6116-1abe-5294-9d40-f30e22ecebcd with identifier: DP85983
2026-03-30 05:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81f6116-1abe-5294-9d40-f30e22ecebcd with scrape type 2
2026-03-30 05:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c81f6116-1abe-5294-9d40-f30e22ecebcd with scrape type 2
2026-03-30 05:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c81f6116-1abe-5294-9d40-f30e22ecebcd, identifier: DP85983
2026-03-30 05:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c81f6116-1abe-5294-9d40-f30e22ecebcd with identifier: DP85983
2026-03-30 05:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c81f6116-1abe-5294-9d40-f30e22ecebcd with identifier: DP85983
2026-03-30 05:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c81f6116-1abe-5294-9d40-f30e22ecebcd with identifier: DP85983 to the API
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:23:17Z',
 'fuel_type': 'diesel',
 'id': 'c81f6116-1abe-5294-9d40-f30e22ecebcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP85983',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 117669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2018}
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Saving data for DP85983: {'auction_closing_time': 1774884197.0, 'created_time': 1773916237.812963, 'last_price_update_time': 1774848939.422335}
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP85983') HTTP/1.1" 204 0
2026-03-30 05:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for XT00440: 0
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for KA95549: 2
2026-03-30 05:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d11c87e-9939-58f5-a4b7-a057201611c8 with identifier: KA95549
2026-03-30 05:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d11c87e-9939-58f5-a4b7-a057201611c8 with scrape type 2
2026-03-30 05:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d11c87e-9939-58f5-a4b7-a057201611c8 with scrape type 2
2026-03-30 05:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d11c87e-9939-58f5-a4b7-a057201611c8, identifier: KA95549
2026-03-30 05:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d11c87e-9939-58f5-a4b7-a057201611c8 with identifier: KA95549
2026-03-30 05:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d11c87e-9939-58f5-a4b7-a057201611c8 with identifier: KA95549
2026-03-30 05:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d11c87e-9939-58f5-a4b7-a057201611c8 with identifier: KA95549 to the API
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:31:07Z',
 'fuel_type': 'petrol',
 'id': '8d11c87e-9939-58f5-a4b7-a057201611c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA95549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 35969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban Style Edition',
 'transmission': 'automatic',
 'trim': 'Urban Style Edition',
 'year': 2018}
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Saving data for KA95549: {'auction_closing_time': 1774884667.0, 'created_time': 1774636977.787711, 'last_price_update_time': 1774848939.936694}
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA95549') HTTP/1.1" 204 0
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for DL51973: 0
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-30 05:35:39 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-30 05:35:39 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-30 05:35:40 [auto1.de] INFO: Scrape type for FW13122: 2
2026-03-30 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a6c58e1-da55-5bb5-848d-4db845470ad1 with identifier: FW13122
2026-03-30 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a6c58e1-da55-5bb5-848d-4db845470ad1 with scrape type 2
2026-03-30 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a6c58e1-da55-5bb5-848d-4db845470ad1 with scrape type 2
2026-03-30 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a6c58e1-da55-5bb5-848d-4db845470ad1, identifier: FW13122
2026-03-30 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a6c58e1-da55-5bb5-848d-4db845470ad1 with identifier: FW13122
2026-03-30 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a6c58e1-da55-5bb5-848d-4db845470ad1 with identifier: FW13122
2026-03-30 05:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a6c58e1-da55-5bb5-848d-4db845470ad1 with identifier: FW13122 to the API
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:53Z',
 'fuel_type': 'diesel',
 'id': '0a6c58e1-da55-5bb5-848d-4db845470ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW13122',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 233240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-30 05:35:40 [auto1.de] INFO: Saving data for FW13122: {'auction_closing_time': 1774883993.0, 'created_time': 1774638274.833084, 'last_price_update_time': 1774848940.368145}
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW13122') HTTP/1.1" 204 0
2026-03-30 05:35:40 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 05:35:40 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-30 05:35:40 [auto1.de] INFO: Scrape type for UE91712: 2
2026-03-30 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-30 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c314c7-23c9-5995-be4b-e85c3de39485 with scrape type 2
2026-03-30 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c314c7-23c9-5995-be4b-e85c3de39485 with scrape type 2
2026-03-30 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c314c7-23c9-5995-be4b-e85c3de39485, identifier: UE91712
2026-03-30 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-30 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712
2026-03-30 05:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c314c7-23c9-5995-be4b-e85c3de39485 with identifier: UE91712 to the API
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:02:27Z',
 'fuel_type': 'petrol',
 'id': 'a3c314c7-23c9-5995-be4b-e85c3de39485',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE91712',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 246357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-30 05:35:40 [auto1.de] INFO: Saving data for UE91712: {'auction_closing_time': 1774882947.0, 'created_time': 1773345407.049446, 'last_price_update_time': 1774848940.861478}
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE91712') HTTP/1.1" 204 0
2026-03-30 05:35:40 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-30 05:35:40 [auto1.de] INFO: Scrape type for SW23111: 2
2026-03-30 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d94d369e-61d4-55e3-a98e-e31d093a15d7 with identifier: SW23111
2026-03-30 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d94d369e-61d4-55e3-a98e-e31d093a15d7 with scrape type 2
2026-03-30 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d94d369e-61d4-55e3-a98e-e31d093a15d7 with scrape type 2
2026-03-30 05:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d94d369e-61d4-55e3-a98e-e31d093a15d7, identifier: SW23111
2026-03-30 05:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d94d369e-61d4-55e3-a98e-e31d093a15d7 with identifier: SW23111
2026-03-30 05:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d94d369e-61d4-55e3-a98e-e31d093a15d7 with identifier: SW23111
2026-03-30 05:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d94d369e-61d4-55e3-a98e-e31d093a15d7 with identifier: SW23111 to the API
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'petrol',
 'id': 'd94d369e-61d4-55e3-a98e-e31d093a15d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW23111',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 135289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2011}
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Saving data for SW23111: {'auction_closing_time': 1774882837.0, 'created_time': 1774638429.377127, 'last_price_update_time': 1774848941.384449}
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW23111') HTTP/1.1" 204 0
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Scrape type for BC27569: 2
2026-03-30 05:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-30 05:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with scrape type 2
2026-03-30 05:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with scrape type 2
2026-03-30 05:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477, identifier: BC27569
2026-03-30 05:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-30 05:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569
2026-03-30 05:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae5e5d71-bd0f-5eec-a284-2e98ef7cd477 with identifier: BC27569 to the API
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:28Z',
 'fuel_type': 'diesel',
 'id': 'ae5e5d71-bd0f-5eec-a284-2e98ef7cd477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC27569',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 232991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-29',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 2.8 CRD Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2009}
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Saving data for BC27569: {'auction_closing_time': 1774883788.0, 'created_time': 1774550541.073067, 'last_price_update_time': 1774848941.829179}
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC27569') HTTP/1.1" 204 0
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 05:35:41 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-30 05:35:41 [auto1.de] INFO: Scrape type for KS86006: 2
2026-03-30 05:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b72a4e99-5403-5598-9b8b-697c170c3aaa with identifier: KS86006
2026-03-30 05:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b72a4e99-5403-5598-9b8b-697c170c3aaa with scrape type 2
2026-03-30 05:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b72a4e99-5403-5598-9b8b-697c170c3aaa with scrape type 2
2026-03-30 05:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b72a4e99-5403-5598-9b8b-697c170c3aaa, identifier: KS86006
2026-03-30 05:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b72a4e99-5403-5598-9b8b-697c170c3aaa with identifier: KS86006
2026-03-30 05:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b72a4e99-5403-5598-9b8b-697c170c3aaa with identifier: KS86006
2026-03-30 05:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b72a4e99-5403-5598-9b8b-697c170c3aaa with identifier: KS86006 to the API
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'petrol',
 'id': 'b72a4e99-5403-5598-9b8b-697c170c3aaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS86006',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 78824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-30 05:35:42 [auto1.de] INFO: Saving data for KS86006: {'auction_closing_time': 1774883599.0, 'created_time': 1774002530.635418, 'last_price_update_time': 1774848942.283399}
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS86006') HTTP/1.1" 204 0
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-30 05:35:42 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-30 05:35:42 [auto1.de] INFO: Scrape type for MH82914: 2
2026-03-30 05:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-30 05:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd638ca1-45a3-5302-8f49-5046a040de14 with scrape type 2
2026-03-30 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd638ca1-45a3-5302-8f49-5046a040de14 with scrape type 2
2026-03-30 05:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd638ca1-45a3-5302-8f49-5046a040de14, identifier: MH82914
2026-03-30 05:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-30 05:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914
2026-03-30 05:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd638ca1-45a3-5302-8f49-5046a040de14 with identifier: MH82914 to the API
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:43:37Z',
 'fuel_type': 'diesel',
 'id': 'dd638ca1-45a3-5302-8f49-5046a040de14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH82914',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 204962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-18',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-30 05:35:42 [auto1.de] INFO: Saving data for MH82914: {'auction_closing_time': 1774885417.0, 'created_time': 1774550447.722065, 'last_price_update_time': 1774848942.790947}
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH82914') HTTP/1.1" 204 0
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-30 05:35:42 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-30 05:35:42 [auto1.de] INFO: Scrape type for BF60599: 2
2026-03-30 05:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with identifier: BF60599
2026-03-30 05:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with scrape type 2
2026-03-30 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with scrape type 2
2026-03-30 05:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6, identifier: BF60599
2026-03-30 05:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with identifier: BF60599
2026-03-30 05:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with identifier: BF60599
2026-03-30 05:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 657bfd9c-5c6d-58dd-a034-31e5fcb10cc6 with identifier: BF60599 to the API
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:26:13Z',
 'fuel_type': 'petrol',
 'id': '657bfd9c-5c6d-58dd-a034-31e5fcb10cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF60599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-30 05:35:43 [auto1.de] INFO: Saving data for BF60599: {'auction_closing_time': 1774884373.0, 'created_time': 1774636611.387148, 'last_price_update_time': 1774848943.198495}
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF60599') HTTP/1.1" 204 0
2026-03-30 05:35:43 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-30 05:35:43 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-30 05:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:43 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:43 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-30 05:35:43 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-30 05:35:43 [auto1.de] INFO: Scrape type for YG83893: 2
2026-03-30 05:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-30 05:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3064a5-0890-58f8-aef4-2e15a6982099 with scrape type 2
2026-03-30 05:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3064a5-0890-58f8-aef4-2e15a6982099 with scrape type 2
2026-03-30 05:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b3064a5-0890-58f8-aef4-2e15a6982099, identifier: YG83893
2026-03-30 05:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-30 05:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893
2026-03-30 05:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b3064a5-0890-58f8-aef4-2e15a6982099 with identifier: YG83893 to the API
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:15:54Z',
 'fuel_type': 'diesel',
 'id': '9b3064a5-0890-58f8-aef4-2e15a6982099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG83893',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 145818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-20',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Saving data for YG83893: {'auction_closing_time': 1774883754.0, 'created_time': 1774552429.399255, 'last_price_update_time': 1774848944.057007}
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG83893') HTTP/1.1" 204 0
2026-03-30 05:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for NS82829: 2
2026-03-30 05:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672cab14-7aed-5632-b93a-4bccfc3e242f with identifier: NS82829
2026-03-30 05:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672cab14-7aed-5632-b93a-4bccfc3e242f with scrape type 2
2026-03-30 05:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 672cab14-7aed-5632-b93a-4bccfc3e242f with scrape type 2
2026-03-30 05:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 672cab14-7aed-5632-b93a-4bccfc3e242f, identifier: NS82829
2026-03-30 05:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 672cab14-7aed-5632-b93a-4bccfc3e242f with identifier: NS82829
2026-03-30 05:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 672cab14-7aed-5632-b93a-4bccfc3e242f with identifier: NS82829
2026-03-30 05:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 672cab14-7aed-5632-b93a-4bccfc3e242f with identifier: NS82829 to the API
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:05Z',
 'fuel_type': 'diesel',
 'id': '672cab14-7aed-5632-b93a-4bccfc3e242f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS82829',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 47414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Saving data for NS82829: {'auction_closing_time': 1774885745.0, 'created_time': 1774349277.559774, 'last_price_update_time': 1774848944.581107}
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS82829') HTTP/1.1" 204 0
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for EN23227: 0
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for DN49518: 0
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-30 05:35:44 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-30 05:35:44 [auto1.de] INFO: Scrape type for RA04600: 2
2026-03-30 05:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-30 05:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd0773d3-7848-596f-a726-9313d9385e89 with scrape type 2
2026-03-30 05:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd0773d3-7848-596f-a726-9313d9385e89 with scrape type 2
2026-03-30 05:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd0773d3-7848-596f-a726-9313d9385e89, identifier: RA04600
2026-03-30 05:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-30 05:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600
2026-03-30 05:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd0773d3-7848-596f-a726-9313d9385e89 with identifier: RA04600 to the API
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:52:36Z',
 'fuel_type': 'diesel',
 'id': 'bd0773d3-7848-596f-a726-9313d9385e89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA04600',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 200199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Audi A4 Allroad 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Saving data for RA04600: {'auction_closing_time': 1774885956.0, 'created_time': 1774675845.51671, 'last_price_update_time': 1774848945.092177}
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA04600') HTTP/1.1" 204 0
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Scrape type for JG55591: 2
2026-03-30 05:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with identifier: JG55591
2026-03-30 05:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with scrape type 2
2026-03-30 05:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with scrape type 2
2026-03-30 05:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a54e0fe-7997-5cd7-abc5-fed81b1368f7, identifier: JG55591
2026-03-30 05:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with identifier: JG55591
2026-03-30 05:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with identifier: JG55591
2026-03-30 05:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a54e0fe-7997-5cd7-abc5-fed81b1368f7 with identifier: JG55591 to the API
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:51Z',
 'fuel_type': 'petrol',
 'id': '6a54e0fe-7997-5cd7-abc5-fed81b1368f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG55591',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 220045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-31',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Saving data for JG55591: {'auction_closing_time': 1774885611.0, 'created_time': 1774639463.970913, 'last_price_update_time': 1774848945.605169}
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG55591') HTTP/1.1" 204 0
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 05:35:45 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-30 05:35:45 [auto1.de] INFO: Scrape type for PJ55553: 2
2026-03-30 05:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with identifier: PJ55553
2026-03-30 05:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with scrape type 2
2026-03-30 05:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with scrape type 2
2026-03-30 05:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 717f4d59-5f8b-5c9b-bbc8-8cee0947f825, identifier: PJ55553
2026-03-30 05:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with identifier: PJ55553
2026-03-30 05:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with identifier: PJ55553
2026-03-30 05:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 717f4d59-5f8b-5c9b-bbc8-8cee0947f825 with identifier: PJ55553 to the API
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:52Z',
 'fuel_type': 'diesel',
 'id': '717f4d59-5f8b-5c9b-bbc8-8cee0947f825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ55553',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 89016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-19',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2015}
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Saving data for PJ55553: {'auction_closing_time': 1774885012.0, 'created_time': 1774636537.911722, 'last_price_update_time': 1774848946.092579}
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ55553') HTTP/1.1" 204 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for YH66607: 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for VU29174: 2
2026-03-30 05:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dc41a15-9460-5572-96da-5f5170d42f12 with identifier: VU29174
2026-03-30 05:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc41a15-9460-5572-96da-5f5170d42f12 with scrape type 2
2026-03-30 05:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dc41a15-9460-5572-96da-5f5170d42f12 with scrape type 2
2026-03-30 05:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dc41a15-9460-5572-96da-5f5170d42f12, identifier: VU29174
2026-03-30 05:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dc41a15-9460-5572-96da-5f5170d42f12 with identifier: VU29174
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 05:35:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dc41a15-9460-5572-96da-5f5170d42f12 with identifier: VU29174
2026-03-30 05:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dc41a15-9460-5572-96da-5f5170d42f12 with identifier: VU29174 to the API
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:42:48Z',
 'fuel_type': 'gas',
 'id': '3dc41a15-9460-5572-96da-5f5170d42f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU29174',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 11710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-21',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2024}
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Saving data for VU29174: {'auction_closing_time': 1774885368.0, 'created_time': 1774349174.427275, 'last_price_update_time': 1774848946.706937}
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU29174') HTTP/1.1" 204 0
2026-03-30 05:35:46 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-30 05:35:46 [auto1.de] INFO: Scrape type for SN95717: 2
2026-03-30 05:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5996ab1-e340-57cc-b699-190e39bbf1d5 with identifier: SN95717
2026-03-30 05:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5996ab1-e340-57cc-b699-190e39bbf1d5 with scrape type 2
2026-03-30 05:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5996ab1-e340-57cc-b699-190e39bbf1d5 with scrape type 2
2026-03-30 05:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5996ab1-e340-57cc-b699-190e39bbf1d5, identifier: SN95717
2026-03-30 05:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5996ab1-e340-57cc-b699-190e39bbf1d5 with identifier: SN95717
2026-03-30 05:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5996ab1-e340-57cc-b699-190e39bbf1d5 with identifier: SN95717
2026-03-30 05:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5996ab1-e340-57cc-b699-190e39bbf1d5 with identifier: SN95717 to the API
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:50:07Z',
 'fuel_type': 'diesel',
 'id': 'b5996ab1-e340-57cc-b699-190e39bbf1d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN95717',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Saving data for SN95717: {'auction_closing_time': 1774885807.0, 'created_time': 1774002407.351437, 'last_price_update_time': 1774848947.203762}
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN95717') HTTP/1.1" 204 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for DK43665: 2
2026-03-30 05:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with identifier: DK43665
2026-03-30 05:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with scrape type 2
2026-03-30 05:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with scrape type 2
2026-03-30 05:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b, identifier: DK43665
2026-03-30 05:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with identifier: DK43665
2026-03-30 05:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with identifier: DK43665
2026-03-30 05:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d99d67d-637e-5052-bc2a-1acc2b7bcc9b with identifier: DK43665 to the API
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:56Z',
 'fuel_type': 'diesel',
 'id': '1d99d67d-637e-5052-bc2a-1acc2b7bcc9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK43665',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 83558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Saving data for DK43665: {'auction_closing_time': 1774882976.0, 'created_time': 1774636586.674311, 'last_price_update_time': 1774848947.594719}
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK43665') HTTP/1.1" 204 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-30 05:35:47 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for HZ88582: 0
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-30 05:35:47 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-30 05:35:47 [auto1.de] INFO: Scrape type for US51436: 2
2026-03-30 05:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa7fc70-8109-572d-8732-c3555fcaa506 with identifier: US51436
2026-03-30 05:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa7fc70-8109-572d-8732-c3555fcaa506 with scrape type 2
2026-03-30 05:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efa7fc70-8109-572d-8732-c3555fcaa506 with scrape type 2
2026-03-30 05:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efa7fc70-8109-572d-8732-c3555fcaa506, identifier: US51436
2026-03-30 05:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efa7fc70-8109-572d-8732-c3555fcaa506 with identifier: US51436
2026-03-30 05:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efa7fc70-8109-572d-8732-c3555fcaa506 with identifier: US51436
2026-03-30 05:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efa7fc70-8109-572d-8732-c3555fcaa506 with identifier: US51436 to the API
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:48:39Z',
 'fuel_type': 'petrol',
 'id': 'efa7fc70-8109-572d-8732-c3555fcaa506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US51436',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 88492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Saving data for US51436: {'auction_closing_time': 1774885719.0, 'created_time': 1773466756.515459, 'last_price_update_time': 1774848948.093288}
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US51436') HTTP/1.1" 204 0
2026-03-30 05:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for SW44796: 2
2026-03-30 05:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-30 05:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with scrape type 2
2026-03-30 05:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with scrape type 2
2026-03-30 05:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d, identifier: SW44796
2026-03-30 05:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-30 05:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796
2026-03-30 05:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d3db507-9b97-5ab8-b17a-5d6f98c2255d with identifier: SW44796 to the API
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:28:20Z',
 'fuel_type': 'petrol',
 'id': '5d3db507-9b97-5ab8-b17a-5d6f98c2255d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW44796',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 70844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-18',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-X Mild-Hybrid Selection AWD',
 'transmission': 'automatic',
 'trim': 'Selection AWD',
 'year': 2020}
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Saving data for SW44796: {'auction_closing_time': 1774884500.0, 'created_time': 1774552735.826005, 'last_price_update_time': 1774848948.680714}
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW44796') HTTP/1.1" 204 0
2026-03-30 05:35:48 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-30 05:35:48 [auto1.de] INFO: Scrape type for BB73401: 2
2026-03-30 05:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with identifier: BB73401
2026-03-30 05:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with scrape type 2
2026-03-30 05:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with scrape type 2
2026-03-30 05:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae1c79ca-e224-5977-9f31-a260fcc9e8d9, identifier: BB73401
2026-03-30 05:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with identifier: BB73401
2026-03-30 05:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with identifier: BB73401
2026-03-30 05:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae1c79ca-e224-5977-9f31-a260fcc9e8d9 with identifier: BB73401 to the API
2026-03-30 05:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:27:43Z',
 'fuel_type': 'hybrid',
 'id': 'ae1c79ca-e224-5977-9f31-a260fcc9e8d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB73401',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 80229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Saving data for BB73401: {'auction_closing_time': 1774884463.0, 'created_time': 1774033339.073175, 'last_price_update_time': 1774848949.172858}
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB73401') HTTP/1.1" 204 0
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Scrape type for XM92815: 2
2026-03-30 05:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-30 05:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a3b41c-7c0b-53b2-a18b-731af48fd845 with scrape type 2
2026-03-30 05:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a3b41c-7c0b-53b2-a18b-731af48fd845 with scrape type 2
2026-03-30 05:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a3b41c-7c0b-53b2-a18b-731af48fd845, identifier: XM92815
2026-03-30 05:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-30 05:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815
2026-03-30 05:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a3b41c-7c0b-53b2-a18b-731af48fd845 with identifier: XM92815 to the API
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'petrol',
 'id': 'b9a3b41c-7c0b-53b2-a18b-731af48fd845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM92815',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 200923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2007}
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Saving data for XM92815: {'auction_closing_time': 1774886039.0, 'created_time': 1774550722.990921, 'last_price_update_time': 1774848949.615902}
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM92815') HTTP/1.1" 204 0
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Scrape type for GE16975: 0
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-30 05:35:49 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-30 05:35:49 [auto1.de] INFO: Scrape type for CH25051: 2
2026-03-30 05:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa9123a8-3645-5756-9571-90cbabd09a58 with identifier: CH25051
2026-03-30 05:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa9123a8-3645-5756-9571-90cbabd09a58 with scrape type 2
2026-03-30 05:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa9123a8-3645-5756-9571-90cbabd09a58 with scrape type 2
2026-03-30 05:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa9123a8-3645-5756-9571-90cbabd09a58, identifier: CH25051
2026-03-30 05:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa9123a8-3645-5756-9571-90cbabd09a58 with identifier: CH25051
2026-03-30 05:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa9123a8-3645-5756-9571-90cbabd09a58 with identifier: CH25051
2026-03-30 05:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa9123a8-3645-5756-9571-90cbabd09a58 with identifier: CH25051 to the API
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:02:02Z',
 'fuel_type': 'petrol',
 'id': 'aa9123a8-3645-5756-9571-90cbabd09a58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH25051',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 142615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-30 05:35:50 [auto1.de] INFO: Saving data for CH25051: {'auction_closing_time': 1774882922.0, 'created_time': 1774639223.076191, 'last_price_update_time': 1774848950.078529}
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH25051') HTTP/1.1" 204 0
2026-03-30 05:35:50 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-30 05:35:50 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-30 05:35:50 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-30 05:35:50 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-30 05:35:50 [auto1.de] INFO: Scrape type for VL21879: 2
2026-03-30 05:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a3a2582-006e-5166-ae67-0a23e81df3ac with identifier: VL21879
2026-03-30 05:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a3a2582-006e-5166-ae67-0a23e81df3ac with scrape type 2
2026-03-30 05:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a3a2582-006e-5166-ae67-0a23e81df3ac with scrape type 2
2026-03-30 05:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a3a2582-006e-5166-ae67-0a23e81df3ac, identifier: VL21879
2026-03-30 05:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a3a2582-006e-5166-ae67-0a23e81df3ac with identifier: VL21879
2026-03-30 05:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a3a2582-006e-5166-ae67-0a23e81df3ac with identifier: VL21879
2026-03-30 05:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a3a2582-006e-5166-ae67-0a23e81df3ac with identifier: VL21879 to the API
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'petrol',
 'id': '2a3a2582-006e-5166-ae67-0a23e81df3ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL21879',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 64059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-03',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2015}
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-30 05:35:50 [auto1.de] INFO: Saving data for VL21879: {'auction_closing_time': 1774884919.0, 'created_time': 1774637278.021815, 'last_price_update_time': 1774848950.594035}
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL21879') HTTP/1.1" 204 0
2026-03-30 05:35:50 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-30 05:35:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:51 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:51 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-30 05:35:51 [auto1.de] INFO: Scrape type for FJ40863: 0
2026-03-30 05:35:51 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-30 05:35:51 [auto1.de] INFO: Scrape type for UX44500: 2
2026-03-30 05:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 924b0eb6-862d-52cc-94ce-8a96a6631c07 with identifier: UX44500
2026-03-30 05:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 924b0eb6-862d-52cc-94ce-8a96a6631c07 with scrape type 2
2026-03-30 05:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 924b0eb6-862d-52cc-94ce-8a96a6631c07 with scrape type 2
2026-03-30 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 924b0eb6-862d-52cc-94ce-8a96a6631c07, identifier: UX44500
2026-03-30 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 924b0eb6-862d-52cc-94ce-8a96a6631c07 with identifier: UX44500
2026-03-30 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 924b0eb6-862d-52cc-94ce-8a96a6631c07 with identifier: UX44500
2026-03-30 05:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 924b0eb6-862d-52cc-94ce-8a96a6631c07 with identifier: UX44500 to the API
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:10:33Z',
 'fuel_type': 'diesel',
 'id': '924b0eb6-862d-52cc-94ce-8a96a6631c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX44500',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 170817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-30 05:35:51 [auto1.de] INFO: Saving data for UX44500: {'auction_closing_time': 1774883433.0, 'created_time': 1774349165.191076, 'last_price_update_time': 1774848951.646074}
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX44500') HTTP/1.1" 204 0
2026-03-30 05:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:51 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-30 05:35:51 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-30 05:35:51 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-30 05:35:51 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-30 05:35:51 [auto1.de] INFO: Scrape type for DY93616: 2
2026-03-30 05:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d145f52-aa2e-5dd7-884b-5b563cd51706 with identifier: DY93616
2026-03-30 05:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d145f52-aa2e-5dd7-884b-5b563cd51706 with scrape type 2
2026-03-30 05:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d145f52-aa2e-5dd7-884b-5b563cd51706 with scrape type 2
2026-03-30 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d145f52-aa2e-5dd7-884b-5b563cd51706, identifier: DY93616
2026-03-30 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d145f52-aa2e-5dd7-884b-5b563cd51706 with identifier: DY93616
2026-03-30 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d145f52-aa2e-5dd7-884b-5b563cd51706 with identifier: DY93616
2026-03-30 05:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d145f52-aa2e-5dd7-884b-5b563cd51706 with identifier: DY93616 to the API
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:10:40Z',
 'fuel_type': 'petrol',
 'id': '2d145f52-aa2e-5dd7-884b-5b563cd51706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY93616',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 94409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 LIVE II',
 'transmission': 'manual',
 'trim': 'LIVE II',
 'year': 2012}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Saving data for DY93616: {'auction_closing_time': 1774883440.0, 'created_time': 1774638766.790299, 'last_price_update_time': 1774848952.067566}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY93616') HTTP/1.1" 204 0
2026-03-30 05:35:52 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Scrape type for BC55610: 2
2026-03-30 05:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with identifier: BC55610
2026-03-30 05:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with scrape type 2
2026-03-30 05:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with scrape type 2
2026-03-30 05:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4a09da5-e2e2-529b-9a97-8e1c55f00d46, identifier: BC55610
2026-03-30 05:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with identifier: BC55610
2026-03-30 05:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with identifier: BC55610
2026-03-30 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4a09da5-e2e2-529b-9a97-8e1c55f00d46 with identifier: BC55610 to the API
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:04Z',
 'fuel_type': 'petrol',
 'id': 'd4a09da5-e2e2-529b-9a97-8e1c55f00d46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC55610',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 39697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-10',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2023}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Saving data for BC55610: {'auction_closing_time': 1774883164.0, 'created_time': 1774639013.771187, 'last_price_update_time': 1774848952.470683}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC55610') HTTP/1.1" 204 0
2026-03-30 05:35:52 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 05:35:52 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Scrape type for YH78241: 0
2026-03-30 05:35:52 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Scrape type for VH36335: 2
2026-03-30 05:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52582a8d-5f11-51e4-855c-5836393f27c1 with identifier: VH36335
2026-03-30 05:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52582a8d-5f11-51e4-855c-5836393f27c1 with scrape type 2
2026-03-30 05:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52582a8d-5f11-51e4-855c-5836393f27c1 with scrape type 2
2026-03-30 05:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52582a8d-5f11-51e4-855c-5836393f27c1, identifier: VH36335
2026-03-30 05:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52582a8d-5f11-51e4-855c-5836393f27c1 with identifier: VH36335
2026-03-30 05:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52582a8d-5f11-51e4-855c-5836393f27c1 with identifier: VH36335
2026-03-30 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52582a8d-5f11-51e4-855c-5836393f27c1 with identifier: VH36335 to the API
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:15:35Z',
 'fuel_type': 'diesel',
 'id': '52582a8d-5f11-51e4-855c-5836393f27c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH36335',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 152317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-30 05:35:52 [auto1.de] INFO: Saving data for VH36335: {'auction_closing_time': 1774883735.0, 'created_time': 1774550044.760307, 'last_price_update_time': 1774848952.991389}
2026-03-30 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH36335') HTTP/1.1" 204 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for XH00472: 2
2026-03-30 05:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a98136a-d0fd-557e-b26a-8d97d753aec0 with identifier: XH00472
2026-03-30 05:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a98136a-d0fd-557e-b26a-8d97d753aec0 with scrape type 2
2026-03-30 05:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a98136a-d0fd-557e-b26a-8d97d753aec0 with scrape type 2
2026-03-30 05:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a98136a-d0fd-557e-b26a-8d97d753aec0, identifier: XH00472
2026-03-30 05:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a98136a-d0fd-557e-b26a-8d97d753aec0 with identifier: XH00472
2026-03-30 05:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a98136a-d0fd-557e-b26a-8d97d753aec0 with identifier: XH00472
2026-03-30 05:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a98136a-d0fd-557e-b26a-8d97d753aec0 with identifier: XH00472 to the API
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:59:56Z',
 'fuel_type': 'petrol',
 'id': '5a98136a-d0fd-557e-b26a-8d97d753aec0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH00472',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Saving data for XH00472: {'auction_closing_time': 1774886396.0, 'created_time': 1774549901.187194, 'last_price_update_time': 1774848953.431705}
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH00472') HTTP/1.1" 204 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for NC31400: 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for YR31209: 2
2026-03-30 05:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d016f1-4370-56c5-b0d7-0eff132dba18 with identifier: YR31209
2026-03-30 05:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d016f1-4370-56c5-b0d7-0eff132dba18 with scrape type 2
2026-03-30 05:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d016f1-4370-56c5-b0d7-0eff132dba18 with scrape type 2
2026-03-30 05:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d016f1-4370-56c5-b0d7-0eff132dba18, identifier: YR31209
2026-03-30 05:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d016f1-4370-56c5-b0d7-0eff132dba18 with identifier: YR31209
2026-03-30 05:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d016f1-4370-56c5-b0d7-0eff132dba18 with identifier: YR31209
2026-03-30 05:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d016f1-4370-56c5-b0d7-0eff132dba18 with identifier: YR31209 to the API
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'diesel',
 'id': 'c3d016f1-4370-56c5-b0d7-0eff132dba18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR31209',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 202693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-22',
 'seller_name': None,
 'title': 'Mazda 3 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2015}
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Saving data for YR31209: {'auction_closing_time': 1774886390.0, 'created_time': 1774636445.407333, 'last_price_update_time': 1774848953.841221}
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR31209') HTTP/1.1" 204 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-30 05:35:53 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-30 05:35:53 [auto1.de] INFO: Scrape type for GB85775: 2
2026-03-30 05:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with identifier: GB85775
2026-03-30 05:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with scrape type 2
2026-03-30 05:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with scrape type 2
2026-03-30 05:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de01aef3-cbbc-5b0f-919b-fbcfe79dd58e, identifier: GB85775
2026-03-30 05:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with identifier: GB85775
2026-03-30 05:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with identifier: GB85775
2026-03-30 05:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de01aef3-cbbc-5b0f-919b-fbcfe79dd58e with identifier: GB85775 to the API
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:22:55Z',
 'fuel_type': 'petrol',
 'id': 'de01aef3-cbbc-5b0f-919b-fbcfe79dd58e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB85775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 89950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Saving data for GB85775: {'auction_closing_time': 1774884175.0, 'created_time': 1773830583.189565, 'last_price_update_time': 1774848954.372146}
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB85775') HTTP/1.1" 204 0
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Scrape type for CN56098: 2
2026-03-30 05:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034b8344-9218-59e7-8f94-bc669b4a8d68 with identifier: CN56098
2026-03-30 05:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034b8344-9218-59e7-8f94-bc669b4a8d68 with scrape type 2
2026-03-30 05:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034b8344-9218-59e7-8f94-bc669b4a8d68 with scrape type 2
2026-03-30 05:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 034b8344-9218-59e7-8f94-bc669b4a8d68, identifier: CN56098
2026-03-30 05:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 034b8344-9218-59e7-8f94-bc669b4a8d68 with identifier: CN56098
2026-03-30 05:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 034b8344-9218-59e7-8f94-bc669b4a8d68 with identifier: CN56098
2026-03-30 05:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 034b8344-9218-59e7-8f94-bc669b4a8d68 with identifier: CN56098 to the API
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:45:24Z',
 'fuel_type': 'diesel',
 'id': '034b8344-9218-59e7-8f94-bc669b4a8d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN56098',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 153802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-12',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2016}
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Saving data for CN56098: {'auction_closing_time': 1774885524.0, 'created_time': 1774636761.605404, 'last_price_update_time': 1774848954.907496}
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN56098') HTTP/1.1" 204 0
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Scrape type for VA96509: 0
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-30 05:35:54 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-30 05:35:54 [auto1.de] INFO: Scrape type for PX02497: 2
2026-03-30 05:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61671477-b629-513d-92d5-32e66cbe1c50 with identifier: PX02497
2026-03-30 05:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61671477-b629-513d-92d5-32e66cbe1c50 with scrape type 2
2026-03-30 05:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61671477-b629-513d-92d5-32e66cbe1c50 with scrape type 2
2026-03-30 05:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61671477-b629-513d-92d5-32e66cbe1c50, identifier: PX02497
2026-03-30 05:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61671477-b629-513d-92d5-32e66cbe1c50 with identifier: PX02497
2026-03-30 05:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61671477-b629-513d-92d5-32e66cbe1c50 with identifier: PX02497
2026-03-30 05:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61671477-b629-513d-92d5-32e66cbe1c50 with identifier: PX02497 to the API
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:13:34Z',
 'fuel_type': 'petrol',
 'id': '61671477-b629-513d-92d5-32e66cbe1c50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX02497',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 102553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Saving data for PX02497: {'auction_closing_time': 1774883614.0, 'created_time': 1774639496.66084, 'last_price_update_time': 1774848955.353546}
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX02497') HTTP/1.1" 204 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for GG35295: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for HU76899: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 05:35:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:55 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-30 05:35:55 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Scrape type for BJ76765: 2
2026-03-30 05:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901debe2-67d4-58c1-91e5-18437d10bc90 with identifier: BJ76765
2026-03-30 05:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901debe2-67d4-58c1-91e5-18437d10bc90 with scrape type 2
2026-03-30 05:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 901debe2-67d4-58c1-91e5-18437d10bc90 with scrape type 2
2026-03-30 05:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 901debe2-67d4-58c1-91e5-18437d10bc90, identifier: BJ76765
2026-03-30 05:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 901debe2-67d4-58c1-91e5-18437d10bc90 with identifier: BJ76765
2026-03-30 05:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 901debe2-67d4-58c1-91e5-18437d10bc90 with identifier: BJ76765
2026-03-30 05:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 901debe2-67d4-58c1-91e5-18437d10bc90 with identifier: BJ76765 to the API
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:10:52Z',
 'fuel_type': 'diesel',
 'id': '901debe2-67d4-58c1-91e5-18437d10bc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ76765',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 203779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-30 05:35:55 [auto1.de] INFO: Saving data for BJ76765: {'auction_closing_time': 1774883452.0, 'created_time': 1774033887.069557, 'last_price_update_time': 1774848955.996388}
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ76765') HTTP/1.1" 204 0
2026-03-30 05:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for BU34226: 2
2026-03-30 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with identifier: BU34226
2026-03-30 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with scrape type 2
2026-03-30 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with scrape type 2
2026-03-30 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26, identifier: BU34226
2026-03-30 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with identifier: BU34226
2026-03-30 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with identifier: BU34226
2026-03-30 05:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d1274e3-3fc3-5407-83f9-23b9ca5e9b26 with identifier: BU34226 to the API
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:07:37Z',
 'fuel_type': 'petrol',
 'id': '0d1274e3-3fc3-5407-83f9-23b9ca5e9b26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU34226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Saving data for BU34226: {'auction_closing_time': 1774883257.0, 'created_time': 1774002146.261657, 'last_price_update_time': 1774848956.594916}
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU34226') HTTP/1.1" 204 0
2026-03-30 05:35:56 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-30 05:35:56 [auto1.de] INFO: Scrape type for LM64010: 2
2026-03-30 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-30 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 340a8418-b555-5731-a0a4-fc225a827e29 with scrape type 2
2026-03-30 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 340a8418-b555-5731-a0a4-fc225a827e29 with scrape type 2
2026-03-30 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 340a8418-b555-5731-a0a4-fc225a827e29, identifier: LM64010
2026-03-30 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-30 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010
2026-03-30 05:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 340a8418-b555-5731-a0a4-fc225a827e29 with identifier: LM64010 to the API
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:35:11Z',
 'fuel_type': 'petrol',
 'id': '340a8418-b555-5731-a0a4-fc225a827e29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM64010',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'IS-Serie',
 'odometer': 221497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-28',
 'seller_name': None,
 'title': 'Lexus IS-Serie IS 200 Sport Cross',
 'transmission': 'manual',
 'trim': 'Sport Cross',
 'year': 2004}
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Saving data for LM64010: {'auction_closing_time': 1774884911.0, 'created_time': 1774550078.714764, 'last_price_update_time': 1774848957.105059}
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM64010') HTTP/1.1" 204 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Scrape type for DB30141: 2
2026-03-30 05:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with identifier: DB30141
2026-03-30 05:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with scrape type 2
2026-03-30 05:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with scrape type 2
2026-03-30 05:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7, identifier: DB30141
2026-03-30 05:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with identifier: DB30141
2026-03-30 05:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with identifier: DB30141
2026-03-30 05:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7 with identifier: DB30141 to the API
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:29Z',
 'fuel_type': 'petrol',
 'id': 'f6d86ea0-a581-5ed4-bc2a-f5cd2924afb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB30141',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 127681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Saving data for DB30141: {'auction_closing_time': 1774886009.0, 'created_time': 1774636819.457768, 'last_price_update_time': 1774848957.49522}
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB30141') HTTP/1.1" 204 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Scrape type for GW76676: 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Scrape type for NZ56847: 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-30 05:35:57 [auto1.de] INFO: Scrape type for VS80969: 0
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 05:35:57 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 05:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:35:58 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6742 | hits on page: 40
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-30 05:35:58 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-30 05:35:58 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-30 05:35:58 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-30 05:35:58 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-30 05:35:58 [auto1.de] INFO: Scrape type for YT58518: 2
2026-03-30 05:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a5624ce-dcc2-54df-aea0-8c7ea175883d with identifier: YT58518
2026-03-30 05:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a5624ce-dcc2-54df-aea0-8c7ea175883d with scrape type 2
2026-03-30 05:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a5624ce-dcc2-54df-aea0-8c7ea175883d with scrape type 2
2026-03-30 05:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a5624ce-dcc2-54df-aea0-8c7ea175883d, identifier: YT58518
2026-03-30 05:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a5624ce-dcc2-54df-aea0-8c7ea175883d with identifier: YT58518
2026-03-30 05:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a5624ce-dcc2-54df-aea0-8c7ea175883d with identifier: YT58518
2026-03-30 05:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a5624ce-dcc2-54df-aea0-8c7ea175883d with identifier: YT58518 to the API
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:44:18Z',
 'fuel_type': 'hybrid',
 'id': '7a5624ce-dcc2-54df-aea0-8c7ea175883d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT58518',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 82674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Saving data for YT58518: {'auction_closing_time': 1774885458.0, 'created_time': 1774349512.755233, 'last_price_update_time': 1774848959.00381}
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT58518') HTTP/1.1" 204 0
2026-03-30 05:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Scrape type for RN98053: 0
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Scrape type for CT73600: 2
2026-03-30 05:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c67c78fe-e876-50df-9786-90e154436b08 with identifier: CT73600
2026-03-30 05:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c67c78fe-e876-50df-9786-90e154436b08 with scrape type 2
2026-03-30 05:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c67c78fe-e876-50df-9786-90e154436b08 with scrape type 2
2026-03-30 05:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c67c78fe-e876-50df-9786-90e154436b08, identifier: CT73600
2026-03-30 05:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c67c78fe-e876-50df-9786-90e154436b08 with identifier: CT73600
2026-03-30 05:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c67c78fe-e876-50df-9786-90e154436b08 with identifier: CT73600
2026-03-30 05:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c67c78fe-e876-50df-9786-90e154436b08 with identifier: CT73600 to the API
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:55:07Z',
 'fuel_type': 'diesel',
 'id': 'c67c78fe-e876-50df-9786-90e154436b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT73600',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 89607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2018}
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Saving data for CT73600: {'auction_closing_time': 1774886107.0, 'created_time': 1774638935.391029, 'last_price_update_time': 1774848959.539075}
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT73600') HTTP/1.1" 204 0
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Scrape type for CK72791: 2
2026-03-30 05:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with identifier: CK72791
2026-03-30 05:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with scrape type 2
2026-03-30 05:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with scrape type 2
2026-03-30 05:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29c47b3e-4018-5f74-9eaa-613f98de6ca5, identifier: CK72791
2026-03-30 05:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with identifier: CK72791
2026-03-30 05:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with identifier: CK72791
2026-03-30 05:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29c47b3e-4018-5f74-9eaa-613f98de6ca5 with identifier: CK72791 to the API
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:35:44Z',
 'fuel_type': 'petrol',
 'id': '29c47b3e-4018-5f74-9eaa-613f98de6ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72791',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 33998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-14',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Saving data for CK72791: {'auction_closing_time': 1774884944.0, 'created_time': 1774638294.824865, 'last_price_update_time': 1774848959.944783}
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72791') HTTP/1.1" 204 0
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-30 05:35:59 [auto1.de] INFO: Scrape type for XR25495: 0
2026-03-30 05:35:59 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Scrape type for GX89038: 2
2026-03-30 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with identifier: GX89038
2026-03-30 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with scrape type 2
2026-03-30 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with scrape type 2
2026-03-30 05:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf64b3a9-ac5f-5d67-9f35-80a778d61d44, identifier: GX89038
2026-03-30 05:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with identifier: GX89038
2026-03-30 05:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with identifier: GX89038
2026-03-30 05:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf64b3a9-ac5f-5d67-9f35-80a778d61d44 with identifier: GX89038 to the API
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:40:33Z',
 'fuel_type': 'diesel',
 'id': 'bf64b3a9-ac5f-5d67-9f35-80a778d61d44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX89038',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 85641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2022}
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Saving data for GX89038: {'auction_closing_time': 1774885233.0, 'created_time': 1774639435.09284, 'last_price_update_time': 1774848960.412654}
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX89038') HTTP/1.1" 204 0
2026-03-30 05:36:00 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-30 05:36:00 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-30 05:36:00 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-30 05:36:00 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-30 05:36:00 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-30 05:36:00 [auto1.de] INFO: Scrape type for RY42515: 2
2026-03-30 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c496c01d-a7e6-5db1-be53-d3da4795d4fd with identifier: RY42515
2026-03-30 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c496c01d-a7e6-5db1-be53-d3da4795d4fd with scrape type 2
2026-03-30 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c496c01d-a7e6-5db1-be53-d3da4795d4fd with scrape type 2
2026-03-30 05:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c496c01d-a7e6-5db1-be53-d3da4795d4fd, identifier: RY42515
2026-03-30 05:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c496c01d-a7e6-5db1-be53-d3da4795d4fd with identifier: RY42515
2026-03-30 05:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c496c01d-a7e6-5db1-be53-d3da4795d4fd with identifier: RY42515
2026-03-30 05:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c496c01d-a7e6-5db1-be53-d3da4795d4fd with identifier: RY42515 to the API
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:38:09Z',
 'fuel_type': 'petrol',
 'id': 'c496c01d-a7e6-5db1-be53-d3da4795d4fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY42515',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 76004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-26',
 'seller_name': None,
 'title': 'Kia Sportage 2.7 V6 EX',
 'transmission': 'automatic',
 'trim': 'V6 EX',
 'year': 2007}
2026-03-30 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-30 05:36:01 [auto1.de] INFO: Saving data for RY42515: {'auction_closing_time': 1774885089.0, 'created_time': 1774637056.044254, 'last_price_update_time': 1774848961.007263}
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY42515') HTTP/1.1" 204 0
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-30 05:36:01 [auto1.de] INFO: Scrape type for BX09216: 2
2026-03-30 05:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-30 05:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31996f20-732f-5493-bd18-996a678ef2f6 with scrape type 2
2026-03-30 05:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31996f20-732f-5493-bd18-996a678ef2f6 with scrape type 2
2026-03-30 05:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31996f20-732f-5493-bd18-996a678ef2f6, identifier: BX09216
2026-03-30 05:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-30 05:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216
2026-03-30 05:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31996f20-732f-5493-bd18-996a678ef2f6 with identifier: BX09216 to the API
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:54:38Z',
 'fuel_type': 'diesel',
 'id': '31996f20-732f-5493-bd18-996a678ef2f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX09216',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 99593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-30 05:36:01 [auto1.de] INFO: Saving data for BX09216: {'auction_closing_time': 1774886078.0, 'created_time': 1773945063.159255, 'last_price_update_time': 1774848961.54022}
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX09216') HTTP/1.1" 204 0
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-30 05:36:01 [auto1.de] INFO: Scrape type for KW79987: 2
2026-03-30 05:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215c5e12-908c-5a44-810d-3ea515a7cd70 with identifier: KW79987
2026-03-30 05:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215c5e12-908c-5a44-810d-3ea515a7cd70 with scrape type 2
2026-03-30 05:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215c5e12-908c-5a44-810d-3ea515a7cd70 with scrape type 2
2026-03-30 05:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 215c5e12-908c-5a44-810d-3ea515a7cd70, identifier: KW79987
2026-03-30 05:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 215c5e12-908c-5a44-810d-3ea515a7cd70 with identifier: KW79987
2026-03-30 05:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 215c5e12-908c-5a44-810d-3ea515a7cd70 with identifier: KW79987
2026-03-30 05:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 215c5e12-908c-5a44-810d-3ea515a7cd70 with identifier: KW79987 to the API
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:46:58Z',
 'fuel_type': 'petrol',
 'id': '215c5e12-908c-5a44-810d-3ea515a7cd70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW79987',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 80135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-30 05:36:01 [auto1.de] INFO: Saving data for KW79987: {'auction_closing_time': 1774885618.0, 'created_time': 1774251071.71242, 'last_price_update_time': 1774848961.964321}
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW79987') HTTP/1.1" 204 0
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-30 05:36:01 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-30 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for SC48990: 2
2026-03-30 05:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-30 05:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c8fb642-e744-51d4-8048-23e8fb274ac3 with scrape type 2
2026-03-30 05:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c8fb642-e744-51d4-8048-23e8fb274ac3 with scrape type 2
2026-03-30 05:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c8fb642-e744-51d4-8048-23e8fb274ac3, identifier: SC48990
2026-03-30 05:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-30 05:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990
2026-03-30 05:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c8fb642-e744-51d4-8048-23e8fb274ac3 with identifier: SC48990 to the API
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'diesel',
 'id': '9c8fb642-e744-51d4-8048-23e8fb274ac3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC48990',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 248165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Saving data for SC48990: {'auction_closing_time': 1774885194.0, 'created_time': 1774552291.941664, 'last_price_update_time': 1774848962.381811}
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC48990') HTTP/1.1" 204 0
2026-03-30 05:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 05:36:02 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Scrape type for TP70009: 2
2026-03-30 05:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with identifier: TP70009
2026-03-30 05:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with scrape type 2
2026-03-30 05:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with scrape type 2
2026-03-30 05:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ead8d188-2c8a-5c27-b4d5-db930f6c6c47, identifier: TP70009
2026-03-30 05:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with identifier: TP70009
2026-03-30 05:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with identifier: TP70009
2026-03-30 05:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ead8d188-2c8a-5c27-b4d5-db930f6c6c47 with identifier: TP70009 to the API
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:12Z',
 'fuel_type': 'diesel',
 'id': 'ead8d188-2c8a-5c27-b4d5-db930f6c6c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP70009',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 392391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-30 05:36:02 [auto1.de] INFO: Saving data for TP70009: {'auction_closing_time': 1774885332.0, 'created_time': 1774636602.375359, 'last_price_update_time': 1774848962.902782}
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP70009') HTTP/1.1" 204 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for SC45462: 2
2026-03-30 05:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6361685b-0dee-579d-aafe-99810ace0682 with identifier: SC45462
2026-03-30 05:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6361685b-0dee-579d-aafe-99810ace0682 with scrape type 2
2026-03-30 05:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6361685b-0dee-579d-aafe-99810ace0682 with scrape type 2
2026-03-30 05:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6361685b-0dee-579d-aafe-99810ace0682, identifier: SC45462
2026-03-30 05:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6361685b-0dee-579d-aafe-99810ace0682 with identifier: SC45462
2026-03-30 05:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6361685b-0dee-579d-aafe-99810ace0682 with identifier: SC45462
2026-03-30 05:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6361685b-0dee-579d-aafe-99810ace0682 with identifier: SC45462 to the API
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'diesel',
 'id': '6361685b-0dee-579d-aafe-99810ace0682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC45462',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 175304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Klassik Kollektion+ 4WD',
 'transmission': 'automatic',
 'trim': 'Klassik Kollektion+ 4WD',
 'year': 2015}
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Saving data for SC45462: {'auction_closing_time': 1774884960.0, 'created_time': 1772729115.571977, 'last_price_update_time': 1774848963.46671}
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC45462') HTTP/1.1" 204 0
2026-03-30 05:36:03 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for DZ52896: 2
2026-03-30 05:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274b94d1-52f3-5119-80bc-6bdc0a087358 with identifier: DZ52896
2026-03-30 05:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274b94d1-52f3-5119-80bc-6bdc0a087358 with scrape type 2
2026-03-30 05:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 274b94d1-52f3-5119-80bc-6bdc0a087358 with scrape type 2
2026-03-30 05:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 274b94d1-52f3-5119-80bc-6bdc0a087358, identifier: DZ52896
2026-03-30 05:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 274b94d1-52f3-5119-80bc-6bdc0a087358 with identifier: DZ52896
2026-03-30 05:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 274b94d1-52f3-5119-80bc-6bdc0a087358 with identifier: DZ52896
2026-03-30 05:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 274b94d1-52f3-5119-80bc-6bdc0a087358 with identifier: DZ52896 to the API
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:10Z',
 'fuel_type': 'diesel',
 'id': '274b94d1-52f3-5119-80bc-6bdc0a087358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ52896',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 125167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Jeep Renegade 1.6 M-Jet Limited Adventure Edition FWD',
 'transmission': 'manual',
 'trim': 'Limited Adventure Edition FWD',
 'year': 2016}
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Saving data for DZ52896: {'auction_closing_time': 1774885870.0, 'created_time': 1774638751.959061, 'last_price_update_time': 1774848963.914399}
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ52896') HTTP/1.1" 204 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-30 05:36:03 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-30 05:36:03 [auto1.de] INFO: Scrape type for NL59823: 2
2026-03-30 05:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74741929-2142-5c59-9fde-1ea1bc504b5a with identifier: NL59823
2026-03-30 05:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74741929-2142-5c59-9fde-1ea1bc504b5a with scrape type 2
2026-03-30 05:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74741929-2142-5c59-9fde-1ea1bc504b5a with scrape type 2
2026-03-30 05:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74741929-2142-5c59-9fde-1ea1bc504b5a, identifier: NL59823
2026-03-30 05:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74741929-2142-5c59-9fde-1ea1bc504b5a with identifier: NL59823
2026-03-30 05:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74741929-2142-5c59-9fde-1ea1bc504b5a with identifier: NL59823
2026-03-30 05:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74741929-2142-5c59-9fde-1ea1bc504b5a with identifier: NL59823 to the API
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:55Z',
 'fuel_type': 'diesel',
 'id': '74741929-2142-5c59-9fde-1ea1bc504b5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL59823',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 160195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Saving data for NL59823: {'auction_closing_time': 1774884295.0, 'created_time': 1774638419.726979, 'last_price_update_time': 1774848964.399642}
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL59823') HTTP/1.1" 204 0
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Scrape type for SC26693: 2
2026-03-30 05:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-30 05:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with scrape type 2
2026-03-30 05:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with scrape type 2
2026-03-30 05:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44, identifier: SC26693
2026-03-30 05:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-30 05:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693
2026-03-30 05:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44 with identifier: SC26693 to the API
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'diesel',
 'id': '67d85cea-5d8a-5b7e-b7a8-b6767c8b6c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC26693',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 108241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-25',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2016}
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Saving data for SC26693: {'auction_closing_time': 1774884877.0, 'created_time': 1774550340.921691, 'last_price_update_time': 1774848964.856867}
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC26693') HTTP/1.1" 204 0
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-30 05:36:04 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-30 05:36:04 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for NG94369: 2
2026-03-30 05:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-03-30 05:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with scrape type 2
2026-03-30 05:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with scrape type 2
2026-03-30 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c07b016d-ee6f-5a70-bba7-c1d167df6aa3, identifier: NG94369
2026-03-30 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-03-30 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369
2026-03-30 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c07b016d-ee6f-5a70-bba7-c1d167df6aa3 with identifier: NG94369 to the API
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:15:40Z',
 'fuel_type': 'diesel',
 'id': 'c07b016d-ee6f-5a70-bba7-c1d167df6aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG94369',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Saving data for NG94369: {'auction_closing_time': 1774883740.0, 'created_time': 1774636933.476539, 'last_price_update_time': 1774848965.441342}
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG94369') HTTP/1.1" 204 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for HG94589: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-30 05:36:05 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Scrape type for LD06025: 2
2026-03-30 05:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 253fb313-5043-573f-9ee6-610cba491e1d with identifier: LD06025
2026-03-30 05:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 253fb313-5043-573f-9ee6-610cba491e1d with scrape type 2
2026-03-30 05:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 253fb313-5043-573f-9ee6-610cba491e1d with scrape type 2
2026-03-30 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 253fb313-5043-573f-9ee6-610cba491e1d, identifier: LD06025
2026-03-30 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 253fb313-5043-573f-9ee6-610cba491e1d with identifier: LD06025
2026-03-30 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 253fb313-5043-573f-9ee6-610cba491e1d with identifier: LD06025
2026-03-30 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 253fb313-5043-573f-9ee6-610cba491e1d with identifier: LD06025 to the API
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:04Z',
 'fuel_type': 'petrol',
 'id': '253fb313-5043-573f-9ee6-610cba491e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD06025',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 98807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-30 05:36:05 [auto1.de] INFO: Saving data for LD06025: {'auction_closing_time': 1774886284.0, 'created_time': 1773302998.479322, 'last_price_update_time': 1774848965.926855}
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD06025') HTTP/1.1" 204 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for NE52715: 2
2026-03-30 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb231f96-bb5b-5976-a03e-7402d86d5c45 with identifier: NE52715
2026-03-30 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb231f96-bb5b-5976-a03e-7402d86d5c45 with scrape type 2
2026-03-30 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb231f96-bb5b-5976-a03e-7402d86d5c45 with scrape type 2
2026-03-30 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb231f96-bb5b-5976-a03e-7402d86d5c45, identifier: NE52715
2026-03-30 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb231f96-bb5b-5976-a03e-7402d86d5c45 with identifier: NE52715
2026-03-30 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb231f96-bb5b-5976-a03e-7402d86d5c45 with identifier: NE52715
2026-03-30 05:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb231f96-bb5b-5976-a03e-7402d86d5c45 with identifier: NE52715 to the API
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:19Z',
 'fuel_type': 'diesel',
 'id': 'bb231f96-bb5b-5976-a03e-7402d86d5c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE52715',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 195850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2011}
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Saving data for NE52715: {'auction_closing_time': 1774884379.0, 'created_time': 1774637466.375595, 'last_price_update_time': 1774848966.455269}
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE52715') HTTP/1.1" 204 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for BB27376: 2
2026-03-30 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-30 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 2
2026-03-30 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with scrape type 2
2026-03-30 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc, identifier: BB27376
2026-03-30 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-30 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376
2026-03-30 05:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc with identifier: BB27376 to the API
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:12Z',
 'fuel_type': 'diesel',
 'id': '13dbd7a3-b85f-5c93-92c3-2eede9aa2fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB27376',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 204104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-28',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Saving data for BB27376: {'auction_closing_time': 1774884492.0, 'created_time': 1774034616.410443, 'last_price_update_time': 1774848966.869358}
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB27376') HTTP/1.1" 204 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 05:36:06 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-30 05:36:06 [auto1.de] INFO: Scrape type for YZ86105: 2
2026-03-30 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc8148e2-3090-562b-a78c-6592196085e2 with identifier: YZ86105
2026-03-30 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc8148e2-3090-562b-a78c-6592196085e2 with scrape type 2
2026-03-30 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc8148e2-3090-562b-a78c-6592196085e2 with scrape type 2
2026-03-30 05:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc8148e2-3090-562b-a78c-6592196085e2, identifier: YZ86105
2026-03-30 05:36:07 [scrapy.extensions.logstats] INFO: Crawled 75 pages (at 14 pages/min), scraped 408 items (at 109 items/min)
2026-03-30 05:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc8148e2-3090-562b-a78c-6592196085e2 with identifier: YZ86105
2026-03-30 05:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc8148e2-3090-562b-a78c-6592196085e2 with identifier: YZ86105
2026-03-30 05:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc8148e2-3090-562b-a78c-6592196085e2 with identifier: YZ86105 to the API
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:32:39Z',
 'fuel_type': 'petrol',
 'id': 'cc8148e2-3090-562b-a78c-6592196085e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ86105',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': '25',
 'odometer': 33616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-31',
 'seller_name': None,
 'title': 'MG Rover 25 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2003}
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-30 05:36:07 [auto1.de] INFO: Saving data for YZ86105: {'auction_closing_time': 1774884759.0, 'created_time': 1774639132.880877, 'last_price_update_time': 1774848967.30574}
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ86105') HTTP/1.1" 204 0
2026-03-30 05:36:07 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-30 05:36:07 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-30 05:36:07 [auto1.de] INFO: Scrape type for AR55742: 2
2026-03-30 05:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-30 05:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d32842-f116-5695-abf0-4d7b89697e3c with scrape type 2
2026-03-30 05:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d32842-f116-5695-abf0-4d7b89697e3c with scrape type 2
2026-03-30 05:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54d32842-f116-5695-abf0-4d7b89697e3c, identifier: AR55742
2026-03-30 05:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-30 05:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742
2026-03-30 05:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54d32842-f116-5695-abf0-4d7b89697e3c with identifier: AR55742 to the API
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:13Z',
 'fuel_type': 'petrol',
 'id': '54d32842-f116-5695-abf0-4d7b89697e3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR55742',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 122769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-30 05:36:07 [auto1.de] INFO: Saving data for AR55742: {'auction_closing_time': 1774885153.0, 'created_time': 1774550443.24556, 'last_price_update_time': 1774848967.704205}
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR55742') HTTP/1.1" 204 0
2026-03-30 05:36:07 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-30 05:36:07 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-30 05:36:07 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-30 05:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:07 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:07 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-30 05:36:07 [auto1.de] INFO: Scrape type for HP91359: 2
2026-03-30 05:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with identifier: HP91359
2026-03-30 05:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with scrape type 2
2026-03-30 05:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with scrape type 2
2026-03-30 05:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7a3a0be-574c-5404-acf0-a5fa2ec7eebf, identifier: HP91359
2026-03-30 05:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with identifier: HP91359
2026-03-30 05:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with identifier: HP91359
2026-03-30 05:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7a3a0be-574c-5404-acf0-a5fa2ec7eebf with identifier: HP91359 to the API
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:07:50Z',
 'fuel_type': 'petrol',
 'id': 'c7a3a0be-574c-5404-acf0-a5fa2ec7eebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP91359',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 65510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-30 05:36:08 [auto1.de] INFO: Saving data for HP91359: {'auction_closing_time': 1774883270.0, 'created_time': 1773427712.235551, 'last_price_update_time': 1774848968.271695}
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP91359') HTTP/1.1" 204 0
2026-03-30 05:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-30 05:36:08 [auto1.de] INFO: Scrape type for VF41212: 2
2026-03-30 05:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with identifier: VF41212
2026-03-30 05:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with scrape type 2
2026-03-30 05:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with scrape type 2
2026-03-30 05:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b771353-6a2f-5b6b-838a-876e6d3a07e2, identifier: VF41212
2026-03-30 05:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with identifier: VF41212
2026-03-30 05:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with identifier: VF41212
2026-03-30 05:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b771353-6a2f-5b6b-838a-876e6d3a07e2 with identifier: VF41212 to the API
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:07:58Z',
 'fuel_type': 'diesel',
 'id': '5b771353-6a2f-5b6b-838a-876e6d3a07e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF41212',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 170441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2016}
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-30 05:36:08 [auto1.de] INFO: Saving data for VF41212: {'auction_closing_time': 1774883278.0, 'created_time': 1774637471.452199, 'last_price_update_time': 1774848968.946496}
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF41212') HTTP/1.1" 204 0
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-30 05:36:08 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-30 05:36:08 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-30 05:36:08 [auto1.de] INFO: Scrape type for WY19584: 2
2026-03-30 05:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df4265d5-ac3a-5188-85a8-39a81e4e681a with identifier: WY19584
2026-03-30 05:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df4265d5-ac3a-5188-85a8-39a81e4e681a with scrape type 2
2026-03-30 05:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df4265d5-ac3a-5188-85a8-39a81e4e681a with scrape type 2
2026-03-30 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df4265d5-ac3a-5188-85a8-39a81e4e681a, identifier: WY19584
2026-03-30 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df4265d5-ac3a-5188-85a8-39a81e4e681a with identifier: WY19584
2026-03-30 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df4265d5-ac3a-5188-85a8-39a81e4e681a with identifier: WY19584
2026-03-30 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df4265d5-ac3a-5188-85a8-39a81e4e681a with identifier: WY19584 to the API
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:29:07Z',
 'fuel_type': 'petrol',
 'id': 'df4265d5-ac3a-5188-85a8-39a81e4e681a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY19584',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 70864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2021}
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Saving data for WY19584: {'auction_closing_time': 1774884547.0, 'created_time': 1774549832.157691, 'last_price_update_time': 1774848969.387544}
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY19584') HTTP/1.1" 204 0
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Scrape type for WG93130: 2
2026-03-30 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb38b01-da4e-5743-9117-90db9aae412b with identifier: WG93130
2026-03-30 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb38b01-da4e-5743-9117-90db9aae412b with scrape type 2
2026-03-30 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb38b01-da4e-5743-9117-90db9aae412b with scrape type 2
2026-03-30 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb38b01-da4e-5743-9117-90db9aae412b, identifier: WG93130
2026-03-30 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb38b01-da4e-5743-9117-90db9aae412b with identifier: WG93130
2026-03-30 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb38b01-da4e-5743-9117-90db9aae412b with identifier: WG93130
2026-03-30 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb38b01-da4e-5743-9117-90db9aae412b with identifier: WG93130 to the API
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:03:07Z',
 'fuel_type': 'petrol',
 'id': 'dfb38b01-da4e-5743-9117-90db9aae412b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG93130',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 189862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Saving data for WG93130: {'auction_closing_time': 1774882987.0, 'created_time': 1773427268.309177, 'last_price_update_time': 1774848969.83026}
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG93130') HTTP/1.1" 204 0
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-30 05:36:09 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-30 05:36:09 [auto1.de] INFO: Scrape type for EN50331: 2
2026-03-30 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f111d99b-fe3c-5425-b39e-c164fefa8dfa with identifier: EN50331
2026-03-30 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f111d99b-fe3c-5425-b39e-c164fefa8dfa with scrape type 2
2026-03-30 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f111d99b-fe3c-5425-b39e-c164fefa8dfa with scrape type 2
2026-03-30 05:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f111d99b-fe3c-5425-b39e-c164fefa8dfa, identifier: EN50331
2026-03-30 05:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f111d99b-fe3c-5425-b39e-c164fefa8dfa with identifier: EN50331
2026-03-30 05:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f111d99b-fe3c-5425-b39e-c164fefa8dfa with identifier: EN50331
2026-03-30 05:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f111d99b-fe3c-5425-b39e-c164fefa8dfa with identifier: EN50331 to the API
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:57:49Z',
 'fuel_type': 'petrol',
 'id': 'f111d99b-fe3c-5425-b39e-c164fefa8dfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN50331',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Saving data for EN50331: {'auction_closing_time': 1774886269.0, 'created_time': 1774251050.890397, 'last_price_update_time': 1774848970.391967}
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN50331') HTTP/1.1" 204 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for NF30454: 2
2026-03-30 05:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with identifier: NF30454
2026-03-30 05:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with scrape type 2
2026-03-30 05:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with scrape type 2
2026-03-30 05:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a75abff-a8d2-5bc9-9e2f-18793500ed9f, identifier: NF30454
2026-03-30 05:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with identifier: NF30454
2026-03-30 05:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with identifier: NF30454
2026-03-30 05:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a75abff-a8d2-5bc9-9e2f-18793500ed9f with identifier: NF30454 to the API
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:35:45Z',
 'fuel_type': 'diesel',
 'id': '2a75abff-a8d2-5bc9-9e2f-18793500ed9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF30454',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-14',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Saving data for NF30454: {'auction_closing_time': 1774884945.0, 'created_time': 1774637776.721021, 'last_price_update_time': 1774848970.814867}
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF30454') HTTP/1.1" 204 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 05:36:10 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-30 05:36:10 [auto1.de] INFO: Scrape type for UK70882: 2
2026-03-30 05:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-30 05:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with scrape type 2
2026-03-30 05:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with scrape type 2
2026-03-30 05:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d, identifier: UK70882
2026-03-30 05:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-30 05:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882
2026-03-30 05:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d with identifier: UK70882 to the API
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:13:24Z',
 'fuel_type': 'petrol',
 'id': '5cbac13d-3e88-5ce9-b8fa-aa6ebb09552d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK70882',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 57398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Saving data for UK70882: {'auction_closing_time': 1774883604.0, 'created_time': 1774552437.423216, 'last_price_update_time': 1774848971.337111}
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK70882') HTTP/1.1" 204 0
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 05:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:11 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-30 05:36:11 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-30 05:36:11 [auto1.de] INFO: Scrape type for SK51641: 2
2026-03-30 05:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8956c735-b18d-53a4-9762-4bb5a9732539 with identifier: SK51641
2026-03-30 05:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8956c735-b18d-53a4-9762-4bb5a9732539 with scrape type 2
2026-03-30 05:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8956c735-b18d-53a4-9762-4bb5a9732539 with scrape type 2
2026-03-30 05:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8956c735-b18d-53a4-9762-4bb5a9732539, identifier: SK51641
2026-03-30 05:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8956c735-b18d-53a4-9762-4bb5a9732539 with identifier: SK51641
2026-03-30 05:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8956c735-b18d-53a4-9762-4bb5a9732539 with identifier: SK51641
2026-03-30 05:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8956c735-b18d-53a4-9762-4bb5a9732539 with identifier: SK51641 to the API
2026-03-30 05:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:34Z',
 'fuel_type': 'petrol',
 'id': '8956c735-b18d-53a4-9762-4bb5a9732539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK51641',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 208450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Saving data for SK51641: {'auction_closing_time': 1774886074.0, 'created_time': 1774349899.124827, 'last_price_update_time': 1774848972.166161}
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK51641') HTTP/1.1" 204 0
2026-03-30 05:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for SM03586: 2
2026-03-30 05:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-30 05:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with scrape type 2
2026-03-30 05:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with scrape type 2
2026-03-30 05:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c39d5f9-e202-5c18-9c23-b7fcb2161354, identifier: SM03586
2026-03-30 05:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-30 05:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586
2026-03-30 05:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c39d5f9-e202-5c18-9c23-b7fcb2161354 with identifier: SM03586 to the API
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:20:26Z',
 'fuel_type': 'petrol',
 'id': '5c39d5f9-e202-5c18-9c23-b7fcb2161354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM03586',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 105014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'BMW 5er 530i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2017}
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Saving data for SM03586: {'auction_closing_time': 1774884026.0, 'created_time': 1774552842.056626, 'last_price_update_time': 1774848972.679052}
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM03586') HTTP/1.1" 204 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 05:36:12 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-30 05:36:12 [auto1.de] INFO: Scrape type for RC86111: 2
2026-03-30 05:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3885ae03-f742-5522-a54a-32e6a9e940e1 with identifier: RC86111
2026-03-30 05:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3885ae03-f742-5522-a54a-32e6a9e940e1 with scrape type 2
2026-03-30 05:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3885ae03-f742-5522-a54a-32e6a9e940e1 with scrape type 2
2026-03-30 05:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3885ae03-f742-5522-a54a-32e6a9e940e1, identifier: RC86111
2026-03-30 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3885ae03-f742-5522-a54a-32e6a9e940e1 with identifier: RC86111
2026-03-30 05:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3885ae03-f742-5522-a54a-32e6a9e940e1 with identifier: RC86111
2026-03-30 05:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3885ae03-f742-5522-a54a-32e6a9e940e1 with identifier: RC86111 to the API
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:28:54Z',
 'fuel_type': 'petrol',
 'id': '3885ae03-f742-5522-a54a-32e6a9e940e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC86111',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 211473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2010}
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Saving data for RC86111: {'auction_closing_time': 1774884534.0, 'created_time': 1773946065.295971, 'last_price_update_time': 1774848973.285427}
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC86111') HTTP/1.1" 204 0
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Scrape type for VR75394: 2
2026-03-30 05:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1dd8e35-c490-56ae-9d4c-ad4115364412 with identifier: VR75394
2026-03-30 05:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1dd8e35-c490-56ae-9d4c-ad4115364412 with scrape type 2
2026-03-30 05:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1dd8e35-c490-56ae-9d4c-ad4115364412 with scrape type 2
2026-03-30 05:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1dd8e35-c490-56ae-9d4c-ad4115364412, identifier: VR75394
2026-03-30 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1dd8e35-c490-56ae-9d4c-ad4115364412 with identifier: VR75394
2026-03-30 05:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1dd8e35-c490-56ae-9d4c-ad4115364412 with identifier: VR75394
2026-03-30 05:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1dd8e35-c490-56ae-9d4c-ad4115364412 with identifier: VR75394 to the API
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:44:09Z',
 'fuel_type': 'petrol',
 'id': 'e1dd8e35-c490-56ae-9d4c-ad4115364412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR75394',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 140 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 1998}
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Saving data for VR75394: {'auction_closing_time': 1774885449.0, 'created_time': 1774639341.19263, 'last_price_update_time': 1774848973.780583}
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR75394') HTTP/1.1" 204 0
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Scrape type for GH26905: 0
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 05:36:13 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-30 05:36:13 [auto1.de] INFO: Scrape type for GP45415: 2
2026-03-30 05:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee101308-2723-5df4-bf3d-40bfc2552b48 with identifier: GP45415
2026-03-30 05:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee101308-2723-5df4-bf3d-40bfc2552b48 with scrape type 2
2026-03-30 05:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee101308-2723-5df4-bf3d-40bfc2552b48 with scrape type 2
2026-03-30 05:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee101308-2723-5df4-bf3d-40bfc2552b48, identifier: GP45415
2026-03-30 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee101308-2723-5df4-bf3d-40bfc2552b48 with identifier: GP45415
2026-03-30 05:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee101308-2723-5df4-bf3d-40bfc2552b48 with identifier: GP45415
2026-03-30 05:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee101308-2723-5df4-bf3d-40bfc2552b48 with identifier: GP45415 to the API
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:56Z',
 'fuel_type': 'petrol',
 'id': 'ee101308-2723-5df4-bf3d-40bfc2552b48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP45415',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 175511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-30 05:36:14 [auto1.de] INFO: Saving data for GP45415: {'auction_closing_time': 1774883276.0, 'created_time': 1773346653.66859, 'last_price_update_time': 1774848974.26727}
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP45415') HTTP/1.1" 204 0
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-30 05:36:14 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-30 05:36:14 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-30 05:36:14 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-30 05:36:14 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-30 05:36:14 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-30 05:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:15 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for PN07086: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for DD95746: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for ZK33939: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for RV27706: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for HE21190: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: US71241
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-30 05:36:15 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Scrape type for MY97637: 2
2026-03-30 05:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d256aeb-e727-5c13-b622-2af7be30d93d with identifier: MY97637
2026-03-30 05:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d256aeb-e727-5c13-b622-2af7be30d93d with scrape type 2
2026-03-30 05:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d256aeb-e727-5c13-b622-2af7be30d93d with scrape type 2
2026-03-30 05:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d256aeb-e727-5c13-b622-2af7be30d93d, identifier: MY97637
2026-03-30 05:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d256aeb-e727-5c13-b622-2af7be30d93d with identifier: MY97637
2026-03-30 05:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d256aeb-e727-5c13-b622-2af7be30d93d with identifier: MY97637
2026-03-30 05:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d256aeb-e727-5c13-b622-2af7be30d93d with identifier: MY97637 to the API
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:25:26Z',
 'fuel_type': 'petrol',
 'id': '2d256aeb-e727-5c13-b622-2af7be30d93d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY97637',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 46090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-21',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2023}
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-30 05:36:15 [auto1.de] INFO: Saving data for MY97637: {'auction_closing_time': 1774884326.0, 'created_time': 1773860728.332879, 'last_price_update_time': 1774848975.966029}
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY97637') HTTP/1.1" 204 0
2026-03-30 05:36:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for HG38928: 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for JT99615: 2
2026-03-30 05:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with identifier: JT99615
2026-03-30 05:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with scrape type 2
2026-03-30 05:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with scrape type 2
2026-03-30 05:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02, identifier: JT99615
2026-03-30 05:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with identifier: JT99615
2026-03-30 05:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with identifier: JT99615
2026-03-30 05:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bc2e118-2fa0-58d9-96e8-13a87aaa8a02 with identifier: JT99615 to the API
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'diesel',
 'id': '3bc2e118-2fa0-58d9-96e8-13a87aaa8a02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT99615',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 132058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Saving data for JT99615: {'auction_closing_time': 1774884352.0, 'created_time': 1774550428.997299, 'last_price_update_time': 1774848976.564838}
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT99615') HTTP/1.1" 204 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-30 05:36:16 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-30 05:36:16 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-30 05:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:17 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-30 05:36:17 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-30 05:36:17 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-30 05:36:17 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-30 05:36:17 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-30 05:36:17 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-30 05:36:17 [auto1.de] INFO: Scrape type for MU35402: 2
2026-03-30 05:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 825c75fd-a660-58d3-b5a1-7be233f6ef3b with identifier: MU35402
2026-03-30 05:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 825c75fd-a660-58d3-b5a1-7be233f6ef3b with scrape type 2
2026-03-30 05:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 825c75fd-a660-58d3-b5a1-7be233f6ef3b with scrape type 2
2026-03-30 05:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 825c75fd-a660-58d3-b5a1-7be233f6ef3b, identifier: MU35402
2026-03-30 05:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 825c75fd-a660-58d3-b5a1-7be233f6ef3b with identifier: MU35402
2026-03-30 05:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 825c75fd-a660-58d3-b5a1-7be233f6ef3b with identifier: MU35402
2026-03-30 05:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 825c75fd-a660-58d3-b5a1-7be233f6ef3b with identifier: MU35402 to the API
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:02Z',
 'fuel_type': 'diesel',
 'id': '825c75fd-a660-58d3-b5a1-7be233f6ef3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU35402',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 239189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-04',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Saving data for MU35402: {'auction_closing_time': 1774885862.0, 'created_time': 1774639081.27081, 'last_price_update_time': 1774848978.105144}
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU35402') HTTP/1.1" 204 0
2026-03-30 05:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for ZV83127: 2
2026-03-30 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-30 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with scrape type 2
2026-03-30 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with scrape type 2
2026-03-30 05:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e, identifier: ZV83127
2026-03-30 05:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-30 05:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127
2026-03-30 05:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 720b8c5b-27e1-5a4f-97fa-3a9affa9806e with identifier: ZV83127 to the API
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:33Z',
 'fuel_type': 'diesel',
 'id': '720b8c5b-27e1-5a4f-97fa-3a9affa9806e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV83127',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 148927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-20',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Business',
 'transmission': 'automatic',
 'trim': 'Q4 Business',
 'year': 2019}
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Saving data for ZV83127: {'auction_closing_time': 1774883013.0, 'created_time': 1773343385.55687, 'last_price_update_time': 1774848978.699705}
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV83127') HTTP/1.1" 204 0
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 05:36:18 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-30 05:36:18 [auto1.de] INFO: Scrape type for YA77478: 2
2026-03-30 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-30 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd710a63-9fee-5217-8e6e-983924419a04 with scrape type 2
2026-03-30 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd710a63-9fee-5217-8e6e-983924419a04 with scrape type 2
2026-03-30 05:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd710a63-9fee-5217-8e6e-983924419a04, identifier: YA77478
2026-03-30 05:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-30 05:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478
2026-03-30 05:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd710a63-9fee-5217-8e6e-983924419a04 with identifier: YA77478 to the API
2026-03-30 05:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:19:56Z',
 'fuel_type': 'diesel',
 'id': 'fd710a63-9fee-5217-8e6e-983924419a04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA77478',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 175715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2017}
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-30 05:36:19 [auto1.de] INFO: Saving data for YA77478: {'auction_closing_time': 1774883996.0, 'created_time': 1774551869.129841, 'last_price_update_time': 1774848979.14595}
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA77478') HTTP/1.1" 204 0
2026-03-30 05:36:19 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-30 05:36:19 [auto1.de] INFO: Scrape type for XL73598: 2
2026-03-30 05:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-30 05:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe047ad-52b8-51ec-88f5-94a0046d016a with scrape type 2
2026-03-30 05:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe047ad-52b8-51ec-88f5-94a0046d016a with scrape type 2
2026-03-30 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe047ad-52b8-51ec-88f5-94a0046d016a, identifier: XL73598
2026-03-30 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-30 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598
2026-03-30 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe047ad-52b8-51ec-88f5-94a0046d016a with identifier: XL73598 to the API
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:32:20Z',
 'fuel_type': 'petrol',
 'id': '5fe047ad-52b8-51ec-88f5-94a0046d016a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL73598',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 138244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-16',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2019}
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-30 05:36:19 [auto1.de] INFO: Saving data for XL73598: {'auction_closing_time': 1774884740.0, 'created_time': 1773946268.452074, 'last_price_update_time': 1774848979.697702}
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL73598') HTTP/1.1" 204 0
2026-03-30 05:36:19 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-30 05:36:19 [auto1.de] INFO: Scrape type for UU18213: 2
2026-03-30 05:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e94e23-f4a0-59d0-b633-d1607abe03c7 with identifier: UU18213
2026-03-30 05:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e94e23-f4a0-59d0-b633-d1607abe03c7 with scrape type 2
2026-03-30 05:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e94e23-f4a0-59d0-b633-d1607abe03c7 with scrape type 2
2026-03-30 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80e94e23-f4a0-59d0-b633-d1607abe03c7, identifier: UU18213
2026-03-30 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80e94e23-f4a0-59d0-b633-d1607abe03c7 with identifier: UU18213
2026-03-30 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80e94e23-f4a0-59d0-b633-d1607abe03c7 with identifier: UU18213
2026-03-30 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80e94e23-f4a0-59d0-b633-d1607abe03c7 with identifier: UU18213 to the API
2026-03-30 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:44Z',
 'fuel_type': 'petrol',
 'id': '80e94e23-f4a0-59d0-b633-d1607abe03c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU18213',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 41042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Saving data for UU18213: {'auction_closing_time': 1774885724.0, 'created_time': 1773301139.155467, 'last_price_update_time': 1774848980.138532}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU18213') HTTP/1.1" 204 0
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Scrape type for MW99572: 2
2026-03-30 05:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with identifier: MW99572
2026-03-30 05:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with scrape type 2
2026-03-30 05:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with scrape type 2
2026-03-30 05:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a7b9d4c-03d2-572f-bc4e-5ee957449a31, identifier: MW99572
2026-03-30 05:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with identifier: MW99572
2026-03-30 05:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with identifier: MW99572
2026-03-30 05:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a7b9d4c-03d2-572f-bc4e-5ee957449a31 with identifier: MW99572 to the API
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:29:03Z',
 'fuel_type': 'petrol',
 'id': '1a7b9d4c-03d2-572f-bc4e-5ee957449a31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW99572',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 76860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Saving data for MW99572: {'auction_closing_time': 1774884543.0, 'created_time': 1774637122.346665, 'last_price_update_time': 1774848980.536079}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW99572') HTTP/1.1" 204 0
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Scrape type for HJ94843: 2
2026-03-30 05:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with identifier: HJ94843
2026-03-30 05:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with scrape type 2
2026-03-30 05:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with scrape type 2
2026-03-30 05:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad2bede4-8f17-593f-a57c-e6c8cac4a0a7, identifier: HJ94843
2026-03-30 05:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with identifier: HJ94843
2026-03-30 05:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with identifier: HJ94843
2026-03-30 05:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad2bede4-8f17-593f-a57c-e6c8cac4a0a7 with identifier: HJ94843 to the API
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:37Z',
 'fuel_type': 'diesel',
 'id': 'ad2bede4-8f17-593f-a57c-e6c8cac4a0a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ94843',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 258283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Saving data for HJ94843: {'auction_closing_time': 1774884097.0, 'created_time': 1774251043.713991, 'last_price_update_time': 1774848980.945024}
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ94843') HTTP/1.1" 204 0
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-30 05:36:20 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-30 05:36:20 [auto1.de] INFO: Scrape type for ZY56723: 2
2026-03-30 05:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with identifier: ZY56723
2026-03-30 05:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with scrape type 2
2026-03-30 05:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with scrape type 2
2026-03-30 05:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0, identifier: ZY56723
2026-03-30 05:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with identifier: ZY56723
2026-03-30 05:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with identifier: ZY56723
2026-03-30 05:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0 with identifier: ZY56723 to the API
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:46:40Z',
 'fuel_type': 'diesel',
 'id': 'f5d79473-4e0a-59a4-8c3c-ab97a1c2c0c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY56723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 331709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2013}
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Saving data for ZY56723: {'auction_closing_time': 1774885600.0, 'created_time': 1774032203.823295, 'last_price_update_time': 1774848981.370982}
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY56723') HTTP/1.1" 204 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for BW33957: 2
2026-03-30 05:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-30 05:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cca2414d-82a0-5884-8b6a-2d8db4b67c79 with scrape type 2
2026-03-30 05:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cca2414d-82a0-5884-8b6a-2d8db4b67c79 with scrape type 2
2026-03-30 05:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cca2414d-82a0-5884-8b6a-2d8db4b67c79, identifier: BW33957
2026-03-30 05:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-30 05:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957
2026-03-30 05:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cca2414d-82a0-5884-8b6a-2d8db4b67c79 with identifier: BW33957 to the API
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:19:06Z',
 'fuel_type': 'petrol',
 'id': 'cca2414d-82a0-5884-8b6a-2d8db4b67c79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW33957',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 118388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-12',
 'seller_name': None,
 'title': 'Opel Vectra 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Saving data for BW33957: {'auction_closing_time': 1774883946.0, 'created_time': 1774552125.647715, 'last_price_update_time': 1774848981.761681}
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW33957') HTTP/1.1" 204 0
2026-03-30 05:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-30 05:36:21 [auto1.de] INFO: Scrape type for CW80278: 0
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-30 05:36:21 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:21 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for LW43520: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for ME12043: 2
2026-03-30 05:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-30 05:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42817da0-a9e4-5220-b540-7c68c34a95a3 with scrape type 2
2026-03-30 05:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42817da0-a9e4-5220-b540-7c68c34a95a3 with scrape type 2
2026-03-30 05:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42817da0-a9e4-5220-b540-7c68c34a95a3, identifier: ME12043
2026-03-30 05:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-30 05:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043
2026-03-30 05:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42817da0-a9e4-5220-b540-7c68c34a95a3 with identifier: ME12043 to the API
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:47:32Z',
 'fuel_type': 'petrol',
 'id': '42817da0-a9e4-5220-b540-7c68c34a95a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME12043',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 104297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Saving data for ME12043: {'auction_closing_time': 1774885652.0, 'created_time': 1773984693.363473, 'last_price_update_time': 1774848982.437291}
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME12043') HTTP/1.1" 204 0
2026-03-30 05:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for BT37883: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for ST29936: 0
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 05:36:22 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-30 05:36:22 [auto1.de] INFO: Scrape type for VW79588: 2
2026-03-30 05:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d5753b-532f-5041-a2cf-9eeda444b478 with identifier: VW79588
2026-03-30 05:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d5753b-532f-5041-a2cf-9eeda444b478 with scrape type 2
2026-03-30 05:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75d5753b-532f-5041-a2cf-9eeda444b478 with scrape type 2
2026-03-30 05:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75d5753b-532f-5041-a2cf-9eeda444b478, identifier: VW79588
2026-03-30 05:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75d5753b-532f-5041-a2cf-9eeda444b478 with identifier: VW79588
2026-03-30 05:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75d5753b-532f-5041-a2cf-9eeda444b478 with identifier: VW79588
2026-03-30 05:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75d5753b-532f-5041-a2cf-9eeda444b478 with identifier: VW79588 to the API
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:07:02Z',
 'fuel_type': 'petrol',
 'id': '75d5753b-532f-5041-a2cf-9eeda444b478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW79588',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 99751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2014}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Saving data for VW79588: {'auction_closing_time': 1774883222.0, 'created_time': 1774637782.222048, 'last_price_update_time': 1774848983.049373}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW79588') HTTP/1.1" 204 0
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Scrape type for RX04560: 2
2026-03-30 05:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-30 05:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50e5f97a-1b45-56f5-8740-af7ad89b547e with scrape type 2
2026-03-30 05:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50e5f97a-1b45-56f5-8740-af7ad89b547e with scrape type 2
2026-03-30 05:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50e5f97a-1b45-56f5-8740-af7ad89b547e, identifier: RX04560
2026-03-30 05:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-30 05:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560
2026-03-30 05:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50e5f97a-1b45-56f5-8740-af7ad89b547e with identifier: RX04560 to the API
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:27:40Z',
 'fuel_type': 'petrol',
 'id': '50e5f97a-1b45-56f5-8740-af7ad89b547e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX04560',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 104400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-15',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2021}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Saving data for RX04560: {'auction_closing_time': 1774884460.0, 'created_time': 1774550129.741281, 'last_price_update_time': 1774848983.484045}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX04560') HTTP/1.1" 204 0
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Scrape type for DX03120: 2
2026-03-30 05:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-30 05:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390c59ab-f8be-5d4a-810e-c7a96e38366f with scrape type 2
2026-03-30 05:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 390c59ab-f8be-5d4a-810e-c7a96e38366f with scrape type 2
2026-03-30 05:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 390c59ab-f8be-5d4a-810e-c7a96e38366f, identifier: DX03120
2026-03-30 05:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-30 05:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120
2026-03-30 05:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 390c59ab-f8be-5d4a-810e-c7a96e38366f with identifier: DX03120 to the API
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:46:52Z',
 'fuel_type': 'petrol',
 'id': '390c59ab-f8be-5d4a-810e-c7a96e38366f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX03120',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 184428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-14',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-30 05:36:23 [auto1.de] INFO: Saving data for DX03120: {'auction_closing_time': 1774885612.0, 'created_time': 1774589463.213987, 'last_price_update_time': 1774848983.880668}
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX03120') HTTP/1.1" 204 0
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-30 05:36:23 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Scrape type for UV59464: 0
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Scrape type for GS49465: 2
2026-03-30 05:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-30 05:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fa9163e-df51-5b78-b489-4f2b15385b8b with scrape type 2
2026-03-30 05:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fa9163e-df51-5b78-b489-4f2b15385b8b with scrape type 2
2026-03-30 05:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fa9163e-df51-5b78-b489-4f2b15385b8b, identifier: GS49465
2026-03-30 05:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-30 05:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465
2026-03-30 05:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fa9163e-df51-5b78-b489-4f2b15385b8b with identifier: GS49465 to the API
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:25Z',
 'fuel_type': 'diesel',
 'id': '4fa9163e-df51-5b78-b489-4f2b15385b8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS49465',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 152754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-10',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Ocean Race',
 'transmission': 'automatic',
 'trim': 'Ocean Race',
 'year': 2016}
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Saving data for GS49465: {'auction_closing_time': 1774883785.0, 'created_time': 1774552438.218976, 'last_price_update_time': 1774848984.387494}
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS49465') HTTP/1.1" 204 0
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Scrape type for HF35410: 2
2026-03-30 05:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f79d9f90-c8b8-50a6-a159-7a1585676d4f with identifier: HF35410
2026-03-30 05:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f79d9f90-c8b8-50a6-a159-7a1585676d4f with scrape type 2
2026-03-30 05:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f79d9f90-c8b8-50a6-a159-7a1585676d4f with scrape type 2
2026-03-30 05:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f79d9f90-c8b8-50a6-a159-7a1585676d4f, identifier: HF35410
2026-03-30 05:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f79d9f90-c8b8-50a6-a159-7a1585676d4f with identifier: HF35410
2026-03-30 05:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f79d9f90-c8b8-50a6-a159-7a1585676d4f with identifier: HF35410
2026-03-30 05:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f79d9f90-c8b8-50a6-a159-7a1585676d4f with identifier: HF35410 to the API
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:00Z',
 'fuel_type': 'petrol',
 'id': 'f79d9f90-c8b8-50a6-a159-7a1585676d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF35410',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 124005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-15',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2019}
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Saving data for HF35410: {'auction_closing_time': 1774883640.0, 'created_time': 1774549847.739307, 'last_price_update_time': 1774848984.784553}
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF35410') HTTP/1.1" 204 0
2026-03-30 05:36:24 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-30 05:36:24 [auto1.de] INFO: Scrape type for NS53664: 2
2026-03-30 05:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with identifier: NS53664
2026-03-30 05:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with scrape type 2
2026-03-30 05:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with scrape type 2
2026-03-30 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8, identifier: NS53664
2026-03-30 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with identifier: NS53664
2026-03-30 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with identifier: NS53664
2026-03-30 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8 with identifier: NS53664 to the API
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:48:31Z',
 'fuel_type': 'hybrid',
 'id': '45c7cd90-002f-5cb2-ba8f-4e41dc88b5d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS53664',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 38572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-07',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Saving data for NS53664: {'auction_closing_time': 1774885711.0, 'created_time': 1773830246.371296, 'last_price_update_time': 1774848985.339767}
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS53664') HTTP/1.1" 204 0
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for GY67479: 2
2026-03-30 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fba28930-1858-554d-aed2-b4323b431491 with identifier: GY67479
2026-03-30 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fba28930-1858-554d-aed2-b4323b431491 with scrape type 2
2026-03-30 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fba28930-1858-554d-aed2-b4323b431491 with scrape type 2
2026-03-30 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fba28930-1858-554d-aed2-b4323b431491, identifier: GY67479
2026-03-30 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fba28930-1858-554d-aed2-b4323b431491 with identifier: GY67479
2026-03-30 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fba28930-1858-554d-aed2-b4323b431491 with identifier: GY67479
2026-03-30 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fba28930-1858-554d-aed2-b4323b431491 with identifier: GY67479 to the API
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:24:18Z',
 'fuel_type': 'diesel',
 'id': 'fba28930-1858-554d-aed2-b4323b431491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY67479',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 292249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Saving data for GY67479: {'auction_closing_time': 1774884258.0, 'created_time': 1774639397.345673, 'last_price_update_time': 1774848985.767395}
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY67479') HTTP/1.1" 204 0
2026-03-30 05:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:25 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-30 05:36:25 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-30 05:36:25 [auto1.de] INFO: Scrape type for VJ08081: 2
2026-03-30 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5404aa5-083a-5831-8fa1-a14de41b369e with identifier: VJ08081
2026-03-30 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5404aa5-083a-5831-8fa1-a14de41b369e with scrape type 2
2026-03-30 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5404aa5-083a-5831-8fa1-a14de41b369e with scrape type 2
2026-03-30 05:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5404aa5-083a-5831-8fa1-a14de41b369e, identifier: VJ08081
2026-03-30 05:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5404aa5-083a-5831-8fa1-a14de41b369e with identifier: VJ08081
2026-03-30 05:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5404aa5-083a-5831-8fa1-a14de41b369e with identifier: VJ08081
2026-03-30 05:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5404aa5-083a-5831-8fa1-a14de41b369e with identifier: VJ08081 to the API
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:09:03Z',
 'fuel_type': 'diesel',
 'id': 'b5404aa5-083a-5831-8fa1-a14de41b369e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ08081',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 241367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2014}
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Saving data for VJ08081: {'auction_closing_time': 1774883343.0, 'created_time': 1774550187.961229, 'last_price_update_time': 1774848986.377641}
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ08081') HTTP/1.1" 204 0
2026-03-30 05:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for EE83038: 2
2026-03-30 05:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8fb7700-4214-5d4c-9ffb-0f1da214f52f with identifier: EE83038
2026-03-30 05:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8fb7700-4214-5d4c-9ffb-0f1da214f52f with scrape type 2
2026-03-30 05:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8fb7700-4214-5d4c-9ffb-0f1da214f52f with scrape type 2
2026-03-30 05:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8fb7700-4214-5d4c-9ffb-0f1da214f52f, identifier: EE83038
2026-03-30 05:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8fb7700-4214-5d4c-9ffb-0f1da214f52f with identifier: EE83038
2026-03-30 05:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8fb7700-4214-5d4c-9ffb-0f1da214f52f with identifier: EE83038
2026-03-30 05:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8fb7700-4214-5d4c-9ffb-0f1da214f52f with identifier: EE83038 to the API
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:48:30Z',
 'fuel_type': 'petrol',
 'id': 'b8fb7700-4214-5d4c-9ffb-0f1da214f52f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE83038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 153415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Saving data for EE83038: {'auction_closing_time': 1774885710.0, 'created_time': 1774638898.476886, 'last_price_update_time': 1774848986.910763}
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE83038') HTTP/1.1" 204 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for MM36361: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-30 05:36:26 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 05:36:26 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-30 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for XK03693: 2
2026-03-30 05:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94238272-eada-59aa-81a3-e265c493eeff with identifier: XK03693
2026-03-30 05:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94238272-eada-59aa-81a3-e265c493eeff with scrape type 2
2026-03-30 05:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94238272-eada-59aa-81a3-e265c493eeff with scrape type 2
2026-03-30 05:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94238272-eada-59aa-81a3-e265c493eeff, identifier: XK03693
2026-03-30 05:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94238272-eada-59aa-81a3-e265c493eeff with identifier: XK03693
2026-03-30 05:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94238272-eada-59aa-81a3-e265c493eeff with identifier: XK03693
2026-03-30 05:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94238272-eada-59aa-81a3-e265c493eeff with identifier: XK03693 to the API
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:48:36Z',
 'fuel_type': 'hybrid',
 'id': '94238272-eada-59aa-81a3-e265c493eeff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK03693',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 68735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-16',
 'seller_name': None,
 'title': 'BMW 5er 530e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Saving data for XK03693: {'auction_closing_time': 1774885716.0, 'created_time': 1773830672.783509, 'last_price_update_time': 1774848987.506175}
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK03693') HTTP/1.1" 204 0
2026-03-30 05:36:27 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Scrape type for WL56832: 2
2026-03-30 05:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-30 05:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d659cb2e-2763-5c0e-8fc2-44bc2687124d with scrape type 2
2026-03-30 05:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d659cb2e-2763-5c0e-8fc2-44bc2687124d with scrape type 2
2026-03-30 05:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d659cb2e-2763-5c0e-8fc2-44bc2687124d, identifier: WL56832
2026-03-30 05:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-30 05:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832
2026-03-30 05:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d659cb2e-2763-5c0e-8fc2-44bc2687124d with identifier: WL56832 to the API
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:15Z',
 'fuel_type': 'petrol',
 'id': 'd659cb2e-2763-5c0e-8fc2-44bc2687124d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL56832',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 55278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI R-Line',
 'transmission': 'manual',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-30 05:36:27 [auto1.de] INFO: Saving data for WL56832: {'auction_closing_time': 1774883415.0, 'created_time': 1774552780.195991, 'last_price_update_time': 1774848987.998861}
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL56832') HTTP/1.1" 204 0
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Scrape type for AG34789: 2
2026-03-30 05:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with identifier: AG34789
2026-03-30 05:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with scrape type 2
2026-03-30 05:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with scrape type 2
2026-03-30 05:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2, identifier: AG34789
2026-03-30 05:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with identifier: AG34789
2026-03-30 05:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with identifier: AG34789
2026-03-30 05:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2 with identifier: AG34789 to the API
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:16Z',
 'fuel_type': 'diesel',
 'id': 'cc0d2c3b-b321-5a54-97f0-ec6d33df8ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG34789',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 251021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Saving data for AG34789: {'auction_closing_time': 1774885036.0, 'created_time': 1773306974.866135, 'last_price_update_time': 1774848988.430967}
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG34789') HTTP/1.1" 204 0
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Scrape type for SA01659: 0
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Scrape type for MR61415: 0
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Scrape type for KP87344: 2
2026-03-30 05:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ef453d-6c1b-57ac-af04-bae9b1828756 with identifier: KP87344
2026-03-30 05:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ef453d-6c1b-57ac-af04-bae9b1828756 with scrape type 2
2026-03-30 05:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ef453d-6c1b-57ac-af04-bae9b1828756 with scrape type 2
2026-03-30 05:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46ef453d-6c1b-57ac-af04-bae9b1828756, identifier: KP87344
2026-03-30 05:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46ef453d-6c1b-57ac-af04-bae9b1828756 with identifier: KP87344
2026-03-30 05:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46ef453d-6c1b-57ac-af04-bae9b1828756 with identifier: KP87344
2026-03-30 05:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46ef453d-6c1b-57ac-af04-bae9b1828756 with identifier: KP87344 to the API
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:57:11Z',
 'fuel_type': 'petrol',
 'id': '46ef453d-6c1b-57ac-af04-bae9b1828756',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP87344',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 145438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Corsa Van',
 'transmission': 'manual',
 'trim': 'Van',
 'year': 2005}
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-30 05:36:28 [auto1.de] INFO: Saving data for KP87344: {'auction_closing_time': 1774886231.0, 'created_time': 1774637387.997956, 'last_price_update_time': 1774848988.878411}
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP87344') HTTP/1.1" 204 0
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-30 05:36:28 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-30 05:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:44 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:44 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-30 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-30 05:36:44 [auto1.de] INFO: Scrape type for MS57219: 2
2026-03-30 05:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5133a953-9efe-5d0e-91e2-01cb1fe6093c with identifier: MS57219
2026-03-30 05:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5133a953-9efe-5d0e-91e2-01cb1fe6093c with scrape type 2
2026-03-30 05:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5133a953-9efe-5d0e-91e2-01cb1fe6093c with scrape type 2
2026-03-30 05:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5133a953-9efe-5d0e-91e2-01cb1fe6093c, identifier: MS57219
2026-03-30 05:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5133a953-9efe-5d0e-91e2-01cb1fe6093c with identifier: MS57219
2026-03-30 05:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5133a953-9efe-5d0e-91e2-01cb1fe6093c with identifier: MS57219
2026-03-30 05:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5133a953-9efe-5d0e-91e2-01cb1fe6093c with identifier: MS57219 to the API
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:06:19Z',
 'fuel_type': 'petrol',
 'id': '5133a953-9efe-5d0e-91e2-01cb1fe6093c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS57219',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 136981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2018}
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Saving data for MS57219: {'auction_closing_time': 1774883179.0, 'created_time': 1774033364.43104, 'last_price_update_time': 1774849005.268883}
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS57219') HTTP/1.1" 204 0
2026-03-30 05:36:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Scrape type for HD39951: 2
2026-03-30 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-30 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02b9a86-38cb-539b-a1da-c8ec446dde62 with scrape type 2
2026-03-30 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02b9a86-38cb-539b-a1da-c8ec446dde62 with scrape type 2
2026-03-30 05:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02b9a86-38cb-539b-a1da-c8ec446dde62, identifier: HD39951
2026-03-30 05:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-30 05:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951
2026-03-30 05:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02b9a86-38cb-539b-a1da-c8ec446dde62 with identifier: HD39951 to the API
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:28:04Z',
 'fuel_type': 'petrol',
 'id': 'f02b9a86-38cb-539b-a1da-c8ec446dde62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD39951',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 108776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Saving data for HD39951: {'auction_closing_time': 1774884484.0, 'created_time': 1774552179.223897, 'last_price_update_time': 1774849005.765127}
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD39951') HTTP/1.1" 204 0
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-30 05:36:45 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-30 05:36:45 [auto1.de] INFO: Scrape type for JM51025: 2
2026-03-30 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-30 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with scrape type 2
2026-03-30 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with scrape type 2
2026-03-30 05:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc, identifier: JM51025
2026-03-30 05:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-30 05:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025
2026-03-30 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09b0bba0-a9c5-59eb-b04c-b88e96d18cfc with identifier: JM51025 to the API
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:18:42Z',
 'fuel_type': 'petrol',
 'id': '09b0bba0-a9c5-59eb-b04c-b88e96d18cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM51025',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Saving data for JM51025: {'auction_closing_time': 1774883922.0, 'created_time': 1774551231.436923, 'last_price_update_time': 1774849006.223402}
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM51025') HTTP/1.1" 204 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for TN55927: 2
2026-03-30 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ad69ada-18ca-5fee-ba74-361d4b454260 with identifier: TN55927
2026-03-30 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ad69ada-18ca-5fee-ba74-361d4b454260 with scrape type 2
2026-03-30 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ad69ada-18ca-5fee-ba74-361d4b454260 with scrape type 2
2026-03-30 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ad69ada-18ca-5fee-ba74-361d4b454260, identifier: TN55927
2026-03-30 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ad69ada-18ca-5fee-ba74-361d4b454260 with identifier: TN55927
2026-03-30 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ad69ada-18ca-5fee-ba74-361d4b454260 with identifier: TN55927
2026-03-30 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ad69ada-18ca-5fee-ba74-361d4b454260 with identifier: TN55927 to the API
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:49:43Z',
 'fuel_type': 'petrol',
 'id': '8ad69ada-18ca-5fee-ba74-361d4b454260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN55927',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 135375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Saving data for TN55927: {'auction_closing_time': 1774885783.0, 'created_time': 1774637123.162497, 'last_price_update_time': 1774849006.599182}
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN55927') HTTP/1.1" 204 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for EW11176: 0
2026-03-30 05:36:46 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-30 05:36:46 [auto1.de] INFO: Scrape type for GM15631: 2
2026-03-30 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-30 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e02bbc5a-9714-5f51-996c-d2dd70322067 with scrape type 2
2026-03-30 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e02bbc5a-9714-5f51-996c-d2dd70322067 with scrape type 2
2026-03-30 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e02bbc5a-9714-5f51-996c-d2dd70322067, identifier: GM15631
2026-03-30 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-30 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631
2026-03-30 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e02bbc5a-9714-5f51-996c-d2dd70322067 with identifier: GM15631 to the API
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:44Z',
 'fuel_type': 'petrol',
 'id': 'e02bbc5a-9714-5f51-996c-d2dd70322067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM15631',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 92076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid edition one',
 'transmission': 'automatic',
 'trim': 'edition one',
 'year': 2020}
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-30 05:36:47 [auto1.de] INFO: Saving data for GM15631: {'auction_closing_time': 1774885064.0, 'created_time': 1774550469.559753, 'last_price_update_time': 1774849007.087625}
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM15631') HTTP/1.1" 204 0
2026-03-30 05:36:47 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-30 05:36:47 [auto1.de] INFO: Scrape type for VY52691: 2
2026-03-30 05:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98becd10-3bc5-5558-a962-176e3cb91cd3 with identifier: VY52691
2026-03-30 05:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98becd10-3bc5-5558-a962-176e3cb91cd3 with scrape type 2
2026-03-30 05:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98becd10-3bc5-5558-a962-176e3cb91cd3 with scrape type 2
2026-03-30 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98becd10-3bc5-5558-a962-176e3cb91cd3, identifier: VY52691
2026-03-30 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98becd10-3bc5-5558-a962-176e3cb91cd3 with identifier: VY52691
2026-03-30 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98becd10-3bc5-5558-a962-176e3cb91cd3 with identifier: VY52691
2026-03-30 05:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98becd10-3bc5-5558-a962-176e3cb91cd3 with identifier: VY52691 to the API
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:10:34Z',
 'fuel_type': 'petrol',
 'id': '98becd10-3bc5-5558-a962-176e3cb91cd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY52691',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 118018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-19',
 'seller_name': None,
 'title': 'MINI One BRICK LANE',
 'transmission': 'manual',
 'trim': 'BRICK LANE',
 'year': 2013}
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-30 05:36:47 [auto1.de] INFO: Saving data for VY52691: {'auction_closing_time': 1774883434.0, 'created_time': 1774638105.576567, 'last_price_update_time': 1774849007.580592}
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY52691') HTTP/1.1" 204 0
2026-03-30 05:36:47 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-30 05:36:47 [auto1.de] INFO: Scrape type for SG67731: 2
2026-03-30 05:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with identifier: SG67731
2026-03-30 05:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with scrape type 2
2026-03-30 05:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with scrape type 2
2026-03-30 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cffd5b4-ef72-5ac6-a35c-2feb3653b747, identifier: SG67731
2026-03-30 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with identifier: SG67731
2026-03-30 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with identifier: SG67731
2026-03-30 05:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cffd5b4-ef72-5ac6-a35c-2feb3653b747 with identifier: SG67731 to the API
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:13:19Z',
 'fuel_type': 'diesel',
 'id': '2cffd5b4-ef72-5ac6-a35c-2feb3653b747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG67731',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 197677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-14',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-30 05:36:47 [auto1.de] INFO: Saving data for SG67731: {'auction_closing_time': 1774883599.0, 'created_time': 1774550000.210865, 'last_price_update_time': 1774849007.996386}
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG67731') HTTP/1.1" 204 0
2026-03-30 05:36:48 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-30 05:36:48 [auto1.de] INFO: Scrape type for PC09309: 2
2026-03-30 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-30 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e27a10-695c-5bc0-9bbf-6f380119c199 with scrape type 2
2026-03-30 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e27a10-695c-5bc0-9bbf-6f380119c199 with scrape type 2
2026-03-30 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e27a10-695c-5bc0-9bbf-6f380119c199, identifier: PC09309
2026-03-30 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-30 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309
2026-03-30 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e27a10-695c-5bc0-9bbf-6f380119c199 with identifier: PC09309 to the API
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:30:24Z',
 'fuel_type': 'diesel',
 'id': '68e27a10-695c-5bc0-9bbf-6f380119c199',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC09309',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 94906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-30 05:36:48 [auto1.de] INFO: Saving data for PC09309: {'auction_closing_time': 1774884624.0, 'created_time': 1774550667.933043, 'last_price_update_time': 1774849008.53279}
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC09309') HTTP/1.1" 204 0
2026-03-30 05:36:48 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-30 05:36:48 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-30 05:36:48 [auto1.de] INFO: Scrape type for XK79004: 2
2026-03-30 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with identifier: XK79004
2026-03-30 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with scrape type 2
2026-03-30 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with scrape type 2
2026-03-30 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa, identifier: XK79004
2026-03-30 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with identifier: XK79004
2026-03-30 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with identifier: XK79004
2026-03-30 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b4cdcc0-0ca0-55a6-a676-b230ce2423fa with identifier: XK79004 to the API
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:41:22Z',
 'fuel_type': 'petrol',
 'id': '2b4cdcc0-0ca0-55a6-a676-b230ce2423fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK79004',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 136400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-30 05:36:48 [auto1.de] INFO: Saving data for XK79004: {'auction_closing_time': 1774885282.0, 'created_time': 1773384332.369116, 'last_price_update_time': 1774849008.941495}
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK79004') HTTP/1.1" 204 0
2026-03-30 05:36:48 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-30 05:36:48 [auto1.de] INFO: Scrape type for LG80642: 2
2026-03-30 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-30 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with scrape type 2
2026-03-30 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with scrape type 2
2026-03-30 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8, identifier: LG80642
2026-03-30 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-30 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642
2026-03-30 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f837e7-5dd9-5da5-88c9-5e49d4fefad8 with identifier: LG80642 to the API
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:36:54Z',
 'fuel_type': 'diesel',
 'id': '76f837e7-5dd9-5da5-88c9-5e49d4fefad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG80642',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 121428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-30 05:36:49 [auto1.de] INFO: Saving data for LG80642: {'auction_closing_time': 1774885014.0, 'created_time': 1774550648.898186, 'last_price_update_time': 1774849009.350983}
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG80642') HTTP/1.1" 204 0
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-30 05:36:49 [auto1.de] INFO: Scrape type for MN24694: 2
2026-03-30 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189815bb-72ac-5ec2-b176-3608bfa730b9 with identifier: MN24694
2026-03-30 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189815bb-72ac-5ec2-b176-3608bfa730b9 with scrape type 2
2026-03-30 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189815bb-72ac-5ec2-b176-3608bfa730b9 with scrape type 2
2026-03-30 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 189815bb-72ac-5ec2-b176-3608bfa730b9, identifier: MN24694
2026-03-30 05:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 189815bb-72ac-5ec2-b176-3608bfa730b9 with identifier: MN24694
2026-03-30 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 189815bb-72ac-5ec2-b176-3608bfa730b9 with identifier: MN24694
2026-03-30 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 189815bb-72ac-5ec2-b176-3608bfa730b9 with identifier: MN24694 to the API
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:19:17Z',
 'fuel_type': 'petrol',
 'id': '189815bb-72ac-5ec2-b176-3608bfa730b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN24694',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 212768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-30 05:36:49 [auto1.de] INFO: Saving data for MN24694: {'auction_closing_time': 1774883957.0, 'created_time': 1773227795.793916, 'last_price_update_time': 1774849009.830632}
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN24694') HTTP/1.1" 204 0
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-30 05:36:49 [auto1.de] INFO: Scrape type for MC04391: 0
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-30 05:36:49 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-30 05:36:49 [auto1.de] INFO: Scrape type for RW72462: 2
2026-03-30 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b528921f-afb3-56fb-b0b9-9925b83e459b with identifier: RW72462
2026-03-30 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b528921f-afb3-56fb-b0b9-9925b83e459b with scrape type 2
2026-03-30 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b528921f-afb3-56fb-b0b9-9925b83e459b with scrape type 2
2026-03-30 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b528921f-afb3-56fb-b0b9-9925b83e459b, identifier: RW72462
2026-03-30 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b528921f-afb3-56fb-b0b9-9925b83e459b with identifier: RW72462
2026-03-30 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b528921f-afb3-56fb-b0b9-9925b83e459b with identifier: RW72462
2026-03-30 05:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b528921f-afb3-56fb-b0b9-9925b83e459b with identifier: RW72462 to the API
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:45:54Z',
 'fuel_type': 'petrol',
 'id': 'b528921f-afb3-56fb-b0b9-9925b83e459b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW72462',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 116609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-08',
 'seller_name': None,
 'title': 'Suzuki Splash 1.0 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2012}
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-30 05:36:50 [auto1.de] INFO: Saving data for RW72462: {'auction_closing_time': 1774885554.0, 'created_time': 1773945790.292692, 'last_price_update_time': 1774849010.274684}
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW72462') HTTP/1.1" 204 0
2026-03-30 05:36:50 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-30 05:36:50 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-30 05:36:50 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-30 05:36:50 [auto1.de] INFO: Scrape type for KE01468: 0
2026-03-30 05:36:50 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-30 05:36:50 [auto1.de] INFO: Scrape type for AW33862: 2
2026-03-30 05:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b943261d-8956-57d8-bcd6-998f79056658 with identifier: AW33862
2026-03-30 05:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b943261d-8956-57d8-bcd6-998f79056658 with scrape type 2
2026-03-30 05:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b943261d-8956-57d8-bcd6-998f79056658 with scrape type 2
2026-03-30 05:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b943261d-8956-57d8-bcd6-998f79056658, identifier: AW33862
2026-03-30 05:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b943261d-8956-57d8-bcd6-998f79056658 with identifier: AW33862
2026-03-30 05:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b943261d-8956-57d8-bcd6-998f79056658 with identifier: AW33862
2026-03-30 05:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b943261d-8956-57d8-bcd6-998f79056658 with identifier: AW33862 to the API
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:33:02Z',
 'fuel_type': 'petrol',
 'id': 'b943261d-8956-57d8-bcd6-998f79056658',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW33862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 69462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-30 05:36:50 [auto1.de] INFO: Saving data for AW33862: {'auction_closing_time': 1774884782.0, 'created_time': 1774638534.03103, 'last_price_update_time': 1774849010.825527}
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW33862') HTTP/1.1" 204 0
2026-03-30 05:36:50 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:50 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-30 05:36:50 [auto1.de] INFO: Scrape type for PS82171: 2
2026-03-30 05:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-30 05:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043989f6-023f-522c-bbc9-56db35571a0b with scrape type 2
2026-03-30 05:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043989f6-023f-522c-bbc9-56db35571a0b with scrape type 2
2026-03-30 05:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043989f6-023f-522c-bbc9-56db35571a0b, identifier: PS82171
2026-03-30 05:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-30 05:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171
2026-03-30 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043989f6-023f-522c-bbc9-56db35571a0b with identifier: PS82171 to the API
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:15:33Z',
 'fuel_type': 'petrol',
 'id': '043989f6-023f-522c-bbc9-56db35571a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82171',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 132907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-30 05:36:51 [auto1.de] INFO: Saving data for PS82171: {'auction_closing_time': 1774883733.0, 'created_time': 1774550667.487161, 'last_price_update_time': 1774849011.26345}
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82171') HTTP/1.1" 204 0
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-30 05:36:51 [auto1.de] INFO: Scrape type for YS99143: 2
2026-03-30 05:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-30 05:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cee0cb12-ca0e-581d-807e-72a326aa6b4e with scrape type 2
2026-03-30 05:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cee0cb12-ca0e-581d-807e-72a326aa6b4e with scrape type 2
2026-03-30 05:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cee0cb12-ca0e-581d-807e-72a326aa6b4e, identifier: YS99143
2026-03-30 05:36:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-30 05:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143
2026-03-30 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cee0cb12-ca0e-581d-807e-72a326aa6b4e with identifier: YS99143 to the API
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'petrol',
 'id': 'cee0cb12-ca0e-581d-807e-72a326aa6b4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS99143',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 121242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-16',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-30 05:36:51 [auto1.de] INFO: Saving data for YS99143: {'auction_closing_time': 1774884678.0, 'created_time': 1774550714.253812, 'last_price_update_time': 1774849011.67068}
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS99143') HTTP/1.1" 204 0
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-30 05:36:51 [auto1.de] INFO: Scrape type for WB36208: 0
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 05:36:51 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-30 05:36:51 [auto1.de] INFO: Scrape type for WS03851: 2
2026-03-30 05:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f46da311-7808-57fe-8941-ef0bac16439c with identifier: WS03851
2026-03-30 05:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f46da311-7808-57fe-8941-ef0bac16439c with scrape type 2
2026-03-30 05:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f46da311-7808-57fe-8941-ef0bac16439c with scrape type 2
2026-03-30 05:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f46da311-7808-57fe-8941-ef0bac16439c, identifier: WS03851
2026-03-30 05:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f46da311-7808-57fe-8941-ef0bac16439c with identifier: WS03851
2026-03-30 05:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f46da311-7808-57fe-8941-ef0bac16439c with identifier: WS03851
2026-03-30 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f46da311-7808-57fe-8941-ef0bac16439c with identifier: WS03851 to the API
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:44:57Z',
 'fuel_type': 'petrol',
 'id': 'f46da311-7808-57fe-8941-ef0bac16439c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS03851',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 152305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI',
 'transmission': 'manual',
 'trim': 'GTI',
 'year': 2009}
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-30 05:36:52 [auto1.de] INFO: Saving data for WS03851: {'auction_closing_time': 1774885497.0, 'created_time': 1774638937.245385, 'last_price_update_time': 1774849012.097798}
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS03851') HTTP/1.1" 204 0
2026-03-30 05:36:52 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-30 05:36:52 [auto1.de] INFO: Scrape type for AA01467: 2
2026-03-30 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db94124-2790-51fd-9394-b454e27a9c73 with identifier: AA01467
2026-03-30 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db94124-2790-51fd-9394-b454e27a9c73 with scrape type 2
2026-03-30 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db94124-2790-51fd-9394-b454e27a9c73 with scrape type 2
2026-03-30 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db94124-2790-51fd-9394-b454e27a9c73, identifier: AA01467
2026-03-30 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db94124-2790-51fd-9394-b454e27a9c73 with identifier: AA01467
2026-03-30 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db94124-2790-51fd-9394-b454e27a9c73 with identifier: AA01467
2026-03-30 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db94124-2790-51fd-9394-b454e27a9c73 with identifier: AA01467 to the API
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:52:44Z',
 'fuel_type': 'petrol',
 'id': '7db94124-2790-51fd-9394-b454e27a9c73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA01467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 210764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-30 05:36:52 [auto1.de] INFO: Saving data for AA01467: {'auction_closing_time': 1774885964.0, 'created_time': 1774637917.143156, 'last_price_update_time': 1774849012.607967}
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA01467') HTTP/1.1" 204 0
2026-03-30 05:36:52 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-30 05:36:52 [auto1.de] INFO: Scrape type for LD03873: 2
2026-03-30 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with identifier: LD03873
2026-03-30 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with scrape type 2
2026-03-30 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with scrape type 2
2026-03-30 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48, identifier: LD03873
2026-03-30 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with identifier: LD03873
2026-03-30 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with identifier: LD03873
2026-03-30 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a0d3d78-1895-5f4d-b814-9eaaeb55fd48 with identifier: LD03873 to the API
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:16:35Z',
 'fuel_type': 'petrol',
 'id': '9a0d3d78-1895-5f4d-b814-9eaaeb55fd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD03873',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 256799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-30 05:36:52 [auto1.de] INFO: Saving data for LD03873: {'auction_closing_time': 1774883795.0, 'created_time': 1774639111.670684, 'last_price_update_time': 1774849012.999579}
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD03873') HTTP/1.1" 204 0
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Scrape type for XT20233: 2
2026-03-30 05:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbeab05-552b-5b38-8c94-a59d2e526626 with identifier: XT20233
2026-03-30 05:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbeab05-552b-5b38-8c94-a59d2e526626 with scrape type 2
2026-03-30 05:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbeab05-552b-5b38-8c94-a59d2e526626 with scrape type 2
2026-03-30 05:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abbeab05-552b-5b38-8c94-a59d2e526626, identifier: XT20233
2026-03-30 05:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abbeab05-552b-5b38-8c94-a59d2e526626 with identifier: XT20233
2026-03-30 05:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abbeab05-552b-5b38-8c94-a59d2e526626 with identifier: XT20233
2026-03-30 05:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abbeab05-552b-5b38-8c94-a59d2e526626 with identifier: XT20233 to the API
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:33Z',
 'fuel_type': 'diesel',
 'id': 'abbeab05-552b-5b38-8c94-a59d2e526626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT20233',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 154414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi EcoBlue Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Saving data for XT20233: {'auction_closing_time': 1774883373.0, 'created_time': 1774638797.251878, 'last_price_update_time': 1774849013.397279}
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT20233') HTTP/1.1" 204 0
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Scrape type for FJ71547: 2
2026-03-30 05:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 730d925e-590b-59b6-886c-11b8289d304f with identifier: FJ71547
2026-03-30 05:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 730d925e-590b-59b6-886c-11b8289d304f with scrape type 2
2026-03-30 05:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 730d925e-590b-59b6-886c-11b8289d304f with scrape type 2
2026-03-30 05:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 730d925e-590b-59b6-886c-11b8289d304f, identifier: FJ71547
2026-03-30 05:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 730d925e-590b-59b6-886c-11b8289d304f with identifier: FJ71547
2026-03-30 05:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 730d925e-590b-59b6-886c-11b8289d304f with identifier: FJ71547
2026-03-30 05:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 730d925e-590b-59b6-886c-11b8289d304f with identifier: FJ71547 to the API
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:04:53Z',
 'fuel_type': 'petrol',
 'id': '730d925e-590b-59b6-886c-11b8289d304f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ71547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2012}
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Saving data for FJ71547: {'auction_closing_time': 1774883093.0, 'created_time': 1774349609.948971, 'last_price_update_time': 1774849013.839682}
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ71547') HTTP/1.1" 204 0
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-30 05:36:53 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-30 05:36:53 [auto1.de] INFO: Scrape type for KF63031: 2
2026-03-30 05:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with identifier: KF63031
2026-03-30 05:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with scrape type 2
2026-03-30 05:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with scrape type 2
2026-03-30 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 661f649f-6209-5fcf-b2a8-c77cc998f5d1, identifier: KF63031
2026-03-30 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with identifier: KF63031
2026-03-30 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with identifier: KF63031
2026-03-30 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 661f649f-6209-5fcf-b2a8-c77cc998f5d1 with identifier: KF63031 to the API
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:58:24Z',
 'fuel_type': 'petrol',
 'id': '661f649f-6209-5fcf-b2a8-c77cc998f5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF63031',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 233283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-27',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Saving data for KF63031: {'auction_closing_time': 1774886304.0, 'created_time': 1774639062.318267, 'last_price_update_time': 1774849014.342418}
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF63031') HTTP/1.1" 204 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for EU22008: 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for JT47484: 2
2026-03-30 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-30 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2becf3a3-49ac-5f42-99cc-56b929f21377 with scrape type 2
2026-03-30 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2becf3a3-49ac-5f42-99cc-56b929f21377 with scrape type 2
2026-03-30 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2becf3a3-49ac-5f42-99cc-56b929f21377, identifier: JT47484
2026-03-30 05:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-30 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484
2026-03-30 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2becf3a3-49ac-5f42-99cc-56b929f21377 with identifier: JT47484 to the API
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:16:18Z',
 'fuel_type': 'petrol',
 'id': '2becf3a3-49ac-5f42-99cc-56b929f21377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT47484',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 21128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-12',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.5 ALLGRIP Comfort+',
 'transmission': 'manual',
 'trim': 'ALLGRIP Comfort+',
 'year': 2021}
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Saving data for JT47484: {'auction_closing_time': 1774883778.0, 'created_time': 1774675841.80307, 'last_price_update_time': 1774849014.847607}
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT47484') HTTP/1.1" 204 0
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-30 05:36:54 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-30 05:36:54 [auto1.de] INFO: Scrape type for PW82194: 2
2026-03-30 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-30 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8413472b-2b50-501b-9184-6130f7b9f8c5 with scrape type 2
2026-03-30 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8413472b-2b50-501b-9184-6130f7b9f8c5 with scrape type 2
2026-03-30 05:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8413472b-2b50-501b-9184-6130f7b9f8c5, identifier: PW82194
2026-03-30 05:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-30 05:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194
2026-03-30 05:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8413472b-2b50-501b-9184-6130f7b9f8c5 with identifier: PW82194 to the API
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:58:43Z',
 'fuel_type': 'petrol',
 'id': '8413472b-2b50-501b-9184-6130f7b9f8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW82194',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 128436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-18',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B6 Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Saving data for PW82194: {'auction_closing_time': 1774886323.0, 'created_time': 1774550675.680441, 'last_price_update_time': 1774849015.357793}
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW82194') HTTP/1.1" 204 0
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-30 05:36:55 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Scrape type for XA88514: 2
2026-03-30 05:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with identifier: XA88514
2026-03-30 05:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with scrape type 2
2026-03-30 05:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with scrape type 2
2026-03-30 05:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aa39ef5-f2da-5ba5-b3cb-52574db8442b, identifier: XA88514
2026-03-30 05:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with identifier: XA88514
2026-03-30 05:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with identifier: XA88514
2026-03-30 05:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aa39ef5-f2da-5ba5-b3cb-52574db8442b with identifier: XA88514 to the API
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:44:26Z',
 'fuel_type': 'petrol',
 'id': '5aa39ef5-f2da-5ba5-b3cb-52574db8442b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA88514',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 118870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-23',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TFSI quattro Sport selection',
 'transmission': 'automatic',
 'trim': 'quattro Sport selection',
 'year': 2012}
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Saving data for XA88514: {'auction_closing_time': 1774885466.0, 'created_time': 1774639129.987656, 'last_price_update_time': 1774849015.921132}
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA88514') HTTP/1.1" 204 0
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-30 05:36:55 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-30 05:36:55 [auto1.de] INFO: Scrape type for VE54720: 2
2026-03-30 05:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ee396e9-4d01-5154-ab94-50e2f7300af0 with identifier: VE54720
2026-03-30 05:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ee396e9-4d01-5154-ab94-50e2f7300af0 with scrape type 2
2026-03-30 05:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ee396e9-4d01-5154-ab94-50e2f7300af0 with scrape type 2
2026-03-30 05:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ee396e9-4d01-5154-ab94-50e2f7300af0, identifier: VE54720
2026-03-30 05:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ee396e9-4d01-5154-ab94-50e2f7300af0 with identifier: VE54720
2026-03-30 05:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ee396e9-4d01-5154-ab94-50e2f7300af0 with identifier: VE54720
2026-03-30 05:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ee396e9-4d01-5154-ab94-50e2f7300af0 with identifier: VE54720 to the API
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:10:43Z',
 'fuel_type': 'diesel',
 'id': '8ee396e9-4d01-5154-ab94-50e2f7300af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE54720',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 186954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2015}
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-30 05:36:56 [auto1.de] INFO: Saving data for VE54720: {'auction_closing_time': 1774883443.0, 'created_time': 1774639224.848728, 'last_price_update_time': 1774849016.327227}
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE54720') HTTP/1.1" 204 0
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-30 05:36:56 [auto1.de] INFO: Scrape type for YA52648: 2
2026-03-30 05:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with identifier: YA52648
2026-03-30 05:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with scrape type 2
2026-03-30 05:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with scrape type 2
2026-03-30 05:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4cf03bf-46ce-5e0d-baab-fc84f2704b75, identifier: YA52648
2026-03-30 05:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with identifier: YA52648
2026-03-30 05:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with identifier: YA52648
2026-03-30 05:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4cf03bf-46ce-5e0d-baab-fc84f2704b75 with identifier: YA52648 to the API
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:17Z',
 'fuel_type': 'diesel',
 'id': 'c4cf03bf-46ce-5e0d-baab-fc84f2704b75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA52648',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 77438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2019}
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-30 05:36:56 [auto1.de] INFO: Saving data for YA52648: {'auction_closing_time': 1774883777.0, 'created_time': 1772729103.573204, 'last_price_update_time': 1774849016.836086}
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA52648') HTTP/1.1" 204 0
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 05:36:56 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-30 05:36:56 [auto1.de] INFO: Scrape type for FP35448: 2
2026-03-30 05:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-30 05:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with scrape type 2
2026-03-30 05:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with scrape type 2
2026-03-30 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e, identifier: FP35448
2026-03-30 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-30 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448
2026-03-30 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0ba1c3-dd15-549d-9c11-22a14df51f7e with identifier: FP35448 to the API
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:23Z',
 'fuel_type': 'diesel',
 'id': '6b0ba1c3-dd15-549d-9c11-22a14df51f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP35448',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 292528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Saving data for FP35448: {'auction_closing_time': 1774883303.0, 'created_time': 1774552980.493874, 'last_price_update_time': 1774849017.275743}
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP35448') HTTP/1.1" 204 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for CK93777: 2
2026-03-30 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b681699e-5b0a-50ce-ada8-c72dedf0fbfa with identifier: CK93777
2026-03-30 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b681699e-5b0a-50ce-ada8-c72dedf0fbfa with scrape type 2
2026-03-30 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b681699e-5b0a-50ce-ada8-c72dedf0fbfa with scrape type 2
2026-03-30 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b681699e-5b0a-50ce-ada8-c72dedf0fbfa, identifier: CK93777
2026-03-30 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b681699e-5b0a-50ce-ada8-c72dedf0fbfa with identifier: CK93777
2026-03-30 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b681699e-5b0a-50ce-ada8-c72dedf0fbfa with identifier: CK93777
2026-03-30 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b681699e-5b0a-50ce-ada8-c72dedf0fbfa with identifier: CK93777 to the API
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'diesel',
 'id': 'b681699e-5b0a-50ce-ada8-c72dedf0fbfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK93777',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 136654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Land Rover Defender D240 110 S',
 'transmission': 'automatic',
 'trim': '110 S',
 'year': 2020}
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Saving data for CK93777: {'auction_closing_time': 1774883362.0, 'created_time': 1774638777.427352, 'last_price_update_time': 1774849017.792827}
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK93777') HTTP/1.1" 204 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-30 05:36:57 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-30 05:36:57 [auto1.de] INFO: Scrape type for TX61544: 2
2026-03-30 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5eac5269-0f57-5616-a0e9-a7b233610cb8 with identifier: TX61544
2026-03-30 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5eac5269-0f57-5616-a0e9-a7b233610cb8 with scrape type 2
2026-03-30 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5eac5269-0f57-5616-a0e9-a7b233610cb8 with scrape type 2
2026-03-30 05:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5eac5269-0f57-5616-a0e9-a7b233610cb8, identifier: TX61544
2026-03-30 05:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5eac5269-0f57-5616-a0e9-a7b233610cb8 with identifier: TX61544
2026-03-30 05:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5eac5269-0f57-5616-a0e9-a7b233610cb8 with identifier: TX61544
2026-03-30 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5eac5269-0f57-5616-a0e9-a7b233610cb8 with identifier: TX61544 to the API
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'diesel',
 'id': '5eac5269-0f57-5616-a0e9-a7b233610cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX61544',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse Marco Polo',
 'odometer': 155639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse Marco Polo V 250 d 4Matic Edition',
 'transmission': 'automatic',
 'trim': '4Matic Edition',
 'year': 2019}
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Saving data for TX61544: {'auction_closing_time': 1774885311.0, 'created_time': 1774639164.436987, 'last_price_update_time': 1774849018.323308}
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX61544') HTTP/1.1" 204 0
2026-03-30 05:36:58 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-30 05:36:58 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-30 05:36:58 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Scrape type for MA73958: 2
2026-03-30 05:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with identifier: MA73958
2026-03-30 05:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with scrape type 2
2026-03-30 05:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with scrape type 2
2026-03-30 05:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 484c2805-482d-5c5e-bdf0-2b26e0cf3d12, identifier: MA73958
2026-03-30 05:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with identifier: MA73958
2026-03-30 05:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with identifier: MA73958
2026-03-30 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 484c2805-482d-5c5e-bdf0-2b26e0cf3d12 with identifier: MA73958 to the API
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:59Z',
 'fuel_type': 'petrol',
 'id': '484c2805-482d-5c5e-bdf0-2b26e0cf3d12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA73958',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Tiida',
 'odometer': 91173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-28',
 'seller_name': None,
 'title': 'Nissan Tiida 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2008}
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Saving data for MA73958: {'auction_closing_time': 1774883399.0, 'created_time': 1774637639.057448, 'last_price_update_time': 1774849018.746815}
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA73958') HTTP/1.1" 204 0
2026-03-30 05:36:58 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-30 05:36:58 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-30 05:36:58 [auto1.de] INFO: Scrape type for ZT89022: 2
2026-03-30 05:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with identifier: ZT89022
2026-03-30 05:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with scrape type 2
2026-03-30 05:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with scrape type 2
2026-03-30 05:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710ce988-c7c7-59d8-bf97-9f7e9bcb250e, identifier: ZT89022
2026-03-30 05:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with identifier: ZT89022
2026-03-30 05:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with identifier: ZT89022
2026-03-30 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710ce988-c7c7-59d8-bf97-9f7e9bcb250e with identifier: ZT89022 to the API
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:40Z',
 'fuel_type': 'petrol',
 'id': '710ce988-c7c7-59d8-bf97-9f7e9bcb250e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT89022',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 80011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-17',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Saving data for ZT89022: {'auction_closing_time': 1774884040.0, 'created_time': 1774636553.304432, 'last_price_update_time': 1774849019.180999}
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT89022') HTTP/1.1" 204 0
2026-03-30 05:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for JC65588: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for ZH21180: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 05:36:59 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6742 | hits on page: 40
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for MD20057: 2
2026-03-30 05:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-30 05:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75d7647-c777-5bc1-94f4-a5f13995a7d6 with scrape type 2
2026-03-30 05:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75d7647-c777-5bc1-94f4-a5f13995a7d6 with scrape type 2
2026-03-30 05:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75d7647-c777-5bc1-94f4-a5f13995a7d6, identifier: MD20057
2026-03-30 05:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-30 05:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057
2026-03-30 05:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75d7647-c777-5bc1-94f4-a5f13995a7d6 with identifier: MD20057 to the API
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:00:04Z',
 'fuel_type': 'diesel',
 'id': 'b75d7647-c777-5bc1-94f4-a5f13995a7d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD20057',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 222180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-24',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Saving data for MD20057: {'auction_closing_time': 1774882804.0, 'created_time': 1774552149.76955, 'last_price_update_time': 1774849019.73365}
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD20057') HTTP/1.1" 204 0
2026-03-30 05:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for FL94183: 0
2026-03-30 05:36:59 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-30 05:36:59 [auto1.de] INFO: Scrape type for UW39505: 2
2026-03-30 05:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d195f8b-0fb0-5f83-89ce-88155db224fe with identifier: UW39505
2026-03-30 05:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d195f8b-0fb0-5f83-89ce-88155db224fe with scrape type 2
2026-03-30 05:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d195f8b-0fb0-5f83-89ce-88155db224fe with scrape type 2
2026-03-30 05:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d195f8b-0fb0-5f83-89ce-88155db224fe, identifier: UW39505
2026-03-30 05:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d195f8b-0fb0-5f83-89ce-88155db224fe with identifier: UW39505
2026-03-30 05:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d195f8b-0fb0-5f83-89ce-88155db224fe with identifier: UW39505
2026-03-30 05:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d195f8b-0fb0-5f83-89ce-88155db224fe with identifier: UW39505 to the API
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:57Z',
 'fuel_type': 'petrol',
 'id': '6d195f8b-0fb0-5f83-89ce-88155db224fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW39505',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 160758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2016}
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Saving data for UW39505: {'auction_closing_time': 1774886037.0, 'created_time': 1774349144.7426, 'last_price_update_time': 1774849020.257364}
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW39505') HTTP/1.1" 204 0
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Scrape type for NT27020: 2
2026-03-30 05:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013f6a63-f873-560b-ad84-a5c743122cb3 with identifier: NT27020
2026-03-30 05:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013f6a63-f873-560b-ad84-a5c743122cb3 with scrape type 2
2026-03-30 05:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013f6a63-f873-560b-ad84-a5c743122cb3 with scrape type 2
2026-03-30 05:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013f6a63-f873-560b-ad84-a5c743122cb3, identifier: NT27020
2026-03-30 05:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013f6a63-f873-560b-ad84-a5c743122cb3 with identifier: NT27020
2026-03-30 05:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013f6a63-f873-560b-ad84-a5c743122cb3 with identifier: NT27020
2026-03-30 05:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013f6a63-f873-560b-ad84-a5c743122cb3 with identifier: NT27020 to the API
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:59:04Z',
 'fuel_type': 'diesel',
 'id': '013f6a63-f873-560b-ad84-a5c743122cb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT27020',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 223498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-21',
 'seller_name': None,
 'title': 'Audi Q7 3.0 TDI quattro Avus Extended',
 'transmission': 'automatic',
 'trim': 'quattro Avus Extended',
 'year': 2017}
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Saving data for NT27020: {'auction_closing_time': 1774886344.0, 'created_time': 1774639387.642411, 'last_price_update_time': 1774849020.706567}
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT27020') HTTP/1.1" 204 0
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-30 05:37:00 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-30 05:37:00 [auto1.de] INFO: Scrape type for MS65923: 2
2026-03-30 05:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca68407-3391-5445-9c92-e940a28826a5 with identifier: MS65923
2026-03-30 05:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca68407-3391-5445-9c92-e940a28826a5 with scrape type 2
2026-03-30 05:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca68407-3391-5445-9c92-e940a28826a5 with scrape type 2
2026-03-30 05:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca68407-3391-5445-9c92-e940a28826a5, identifier: MS65923
2026-03-30 05:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca68407-3391-5445-9c92-e940a28826a5 with identifier: MS65923
2026-03-30 05:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca68407-3391-5445-9c92-e940a28826a5 with identifier: MS65923
2026-03-30 05:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca68407-3391-5445-9c92-e940a28826a5 with identifier: MS65923 to the API
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:21:58Z',
 'fuel_type': 'petrol',
 'id': '8ca68407-3391-5445-9c92-e940a28826a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS65923',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 185409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-24',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Saving data for MS65923: {'auction_closing_time': 1774884118.0, 'created_time': 1774638591.459039, 'last_price_update_time': 1774849021.104478}
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS65923') HTTP/1.1" 204 0
2026-03-30 05:37:01 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-30 05:37:01 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-30 05:37:01 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-30 05:37:01 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Scrape type for TU96815: 2
2026-03-30 05:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa11b2f2-2209-5890-acbc-ba9eef524cf5 with identifier: TU96815
2026-03-30 05:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa11b2f2-2209-5890-acbc-ba9eef524cf5 with scrape type 2
2026-03-30 05:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa11b2f2-2209-5890-acbc-ba9eef524cf5 with scrape type 2
2026-03-30 05:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa11b2f2-2209-5890-acbc-ba9eef524cf5, identifier: TU96815
2026-03-30 05:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa11b2f2-2209-5890-acbc-ba9eef524cf5 with identifier: TU96815
2026-03-30 05:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa11b2f2-2209-5890-acbc-ba9eef524cf5 with identifier: TU96815
2026-03-30 05:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa11b2f2-2209-5890-acbc-ba9eef524cf5 with identifier: TU96815 to the API
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:22Z',
 'fuel_type': 'diesel',
 'id': 'aa11b2f2-2209-5890-acbc-ba9eef524cf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU96815',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 215927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Saving data for TU96815: {'auction_closing_time': 1774885642.0, 'created_time': 1774638806.200386, 'last_price_update_time': 1774849021.534319}
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU96815') HTTP/1.1" 204 0
2026-03-30 05:37:01 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-30 05:37:01 [auto1.de] INFO: Scrape type for PE09652: 2
2026-03-30 05:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d7c803-9f31-58d5-8fda-89be379dbce9 with identifier: PE09652
2026-03-30 05:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d7c803-9f31-58d5-8fda-89be379dbce9 with scrape type 2
2026-03-30 05:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52d7c803-9f31-58d5-8fda-89be379dbce9 with scrape type 2
2026-03-30 05:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52d7c803-9f31-58d5-8fda-89be379dbce9, identifier: PE09652
2026-03-30 05:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52d7c803-9f31-58d5-8fda-89be379dbce9 with identifier: PE09652
2026-03-30 05:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52d7c803-9f31-58d5-8fda-89be379dbce9 with identifier: PE09652
2026-03-30 05:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52d7c803-9f31-58d5-8fda-89be379dbce9 with identifier: PE09652 to the API
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-30T15:25:13Z',
 'fuel_type': 'diesel',
 'id': '52d7c803-9f31-58d5-8fda-89be379dbce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE09652',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 114850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion Terrain Tech',
 'transmission': 'automatic',
 'trim': 'BlueMotion Terrain Tech',
 'year': 2015}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Saving data for PE09652: {'auction_closing_time': 1774884313.0, 'created_time': 1774521801.680003, 'last_price_update_time': 1774849022.011035}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE09652') HTTP/1.1" 204 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for LW42175: 2
2026-03-30 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with identifier: LW42175
2026-03-30 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with scrape type 2
2026-03-30 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with scrape type 2
2026-03-30 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70d8f65f-8626-5d12-84b6-b5551cc0e3ea, identifier: LW42175
2026-03-30 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with identifier: LW42175
2026-03-30 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with identifier: LW42175
2026-03-30 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70d8f65f-8626-5d12-84b6-b5551cc0e3ea with identifier: LW42175 to the API
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'petrol',
 'id': '70d8f65f-8626-5d12-84b6-b5551cc0e3ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW42175',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 111233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Life BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Life BlueMotion Tech',
 'year': 2013}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Saving data for LW42175: {'auction_closing_time': 1774885152.0, 'created_time': 1774521351.025453, 'last_price_update_time': 1774849022.418541}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW42175') HTTP/1.1" 204 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for RC01446: 2
2026-03-30 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e82cff7-7709-522c-b3b3-37717cb9afa0 with identifier: RC01446
2026-03-30 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e82cff7-7709-522c-b3b3-37717cb9afa0 with scrape type 2
2026-03-30 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e82cff7-7709-522c-b3b3-37717cb9afa0 with scrape type 2
2026-03-30 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e82cff7-7709-522c-b3b3-37717cb9afa0, identifier: RC01446
2026-03-30 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e82cff7-7709-522c-b3b3-37717cb9afa0 with identifier: RC01446
2026-03-30 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e82cff7-7709-522c-b3b3-37717cb9afa0 with identifier: RC01446
2026-03-30 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e82cff7-7709-522c-b3b3-37717cb9afa0 with identifier: RC01446 to the API
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:40Z',
 'fuel_type': 'diesel',
 'id': '3e82cff7-7709-522c-b3b3-37717cb9afa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC01446',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 91582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Saving data for RC01446: {'auction_closing_time': 1774885780.0, 'created_time': 1774031912.39942, 'last_price_update_time': 1774849022.87944}
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC01446') HTTP/1.1" 204 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for HF86895: 0
2026-03-30 05:37:02 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-30 05:37:02 [auto1.de] INFO: Scrape type for PD67762: 2
2026-03-30 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a1766bd-f046-5345-b0fd-45cc35571583 with identifier: PD67762
2026-03-30 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a1766bd-f046-5345-b0fd-45cc35571583 with scrape type 2
2026-03-30 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a1766bd-f046-5345-b0fd-45cc35571583 with scrape type 2
2026-03-30 05:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a1766bd-f046-5345-b0fd-45cc35571583, identifier: PD67762
2026-03-30 05:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a1766bd-f046-5345-b0fd-45cc35571583 with identifier: PD67762
2026-03-30 05:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a1766bd-f046-5345-b0fd-45cc35571583 with identifier: PD67762
2026-03-30 05:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a1766bd-f046-5345-b0fd-45cc35571583 with identifier: PD67762 to the API
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:02:06Z',
 'fuel_type': 'petrol',
 'id': '4a1766bd-f046-5345-b0fd-45cc35571583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD67762',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 59395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Saving data for PD67762: {'auction_closing_time': 1774882926.0, 'created_time': 1774349320.320838, 'last_price_update_time': 1774849023.32985}
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD67762') HTTP/1.1" 204 0
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Scrape type for SA50642: 0
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Scrape type for HR57506: 2
2026-03-30 05:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with identifier: HR57506
2026-03-30 05:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with scrape type 2
2026-03-30 05:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with scrape type 2
2026-03-30 05:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244, identifier: HR57506
2026-03-30 05:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with identifier: HR57506
2026-03-30 05:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with identifier: HR57506
2026-03-30 05:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8ee3e2-87f2-5700-98d0-7f6ead3cc244 with identifier: HR57506 to the API
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'petrol',
 'id': '3e8ee3e2-87f2-5700-98d0-7f6ead3cc244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR57506',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 74476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-21',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Saving data for HR57506: {'auction_closing_time': 1774883054.0, 'created_time': 1774637891.691318, 'last_price_update_time': 1774849023.756147}
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR57506') HTTP/1.1" 204 0
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-30 05:37:03 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-30 05:37:03 [auto1.de] INFO: Scrape type for TT29598: 2
2026-03-30 05:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4677af0c-7465-5596-9121-fa71252951be with identifier: TT29598
2026-03-30 05:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4677af0c-7465-5596-9121-fa71252951be with scrape type 2
2026-03-30 05:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4677af0c-7465-5596-9121-fa71252951be with scrape type 2
2026-03-30 05:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4677af0c-7465-5596-9121-fa71252951be, identifier: TT29598
2026-03-30 05:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4677af0c-7465-5596-9121-fa71252951be with identifier: TT29598
2026-03-30 05:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4677af0c-7465-5596-9121-fa71252951be with identifier: TT29598
2026-03-30 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4677af0c-7465-5596-9121-fa71252951be with identifier: TT29598 to the API
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:59:43Z',
 'fuel_type': 'diesel',
 'id': '4677af0c-7465-5596-9121-fa71252951be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT29598',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 231641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-17',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2005}
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-30 05:37:04 [auto1.de] INFO: Saving data for TT29598: {'auction_closing_time': 1774886383.0, 'created_time': 1774034363.691111, 'last_price_update_time': 1774849024.309093}
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT29598') HTTP/1.1" 204 0
2026-03-30 05:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:04 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-30 05:37:04 [auto1.de] INFO: Scrape type for XM87462: 2
2026-03-30 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85e842e-5a20-5012-b778-faee12c0dbe8 with identifier: XM87462
2026-03-30 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85e842e-5a20-5012-b778-faee12c0dbe8 with scrape type 2
2026-03-30 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a85e842e-5a20-5012-b778-faee12c0dbe8 with scrape type 2
2026-03-30 05:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a85e842e-5a20-5012-b778-faee12c0dbe8, identifier: XM87462
2026-03-30 05:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a85e842e-5a20-5012-b778-faee12c0dbe8 with identifier: XM87462
2026-03-30 05:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a85e842e-5a20-5012-b778-faee12c0dbe8 with identifier: XM87462
2026-03-30 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a85e842e-5a20-5012-b778-faee12c0dbe8 with identifier: XM87462 to the API
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:13:51Z',
 'fuel_type': 'diesel',
 'id': 'a85e842e-5a20-5012-b778-faee12c0dbe8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM87462',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 211051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-01',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-30 05:37:04 [auto1.de] INFO: Saving data for XM87462: {'auction_closing_time': 1774883631.0, 'created_time': 1774636683.435988, 'last_price_update_time': 1774849024.904424}
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM87462') HTTP/1.1" 204 0
2026-03-30 05:37:04 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-30 05:37:04 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-30 05:37:04 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-30 05:37:04 [auto1.de] INFO: Scrape type for XA78994: 2
2026-03-30 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with identifier: XA78994
2026-03-30 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with scrape type 2
2026-03-30 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with scrape type 2
2026-03-30 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5, identifier: XA78994
2026-03-30 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with identifier: XA78994
2026-03-30 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with identifier: XA78994
2026-03-30 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e5e7e3d-e74a-5e19-b772-b83321e8d3f5 with identifier: XA78994 to the API
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:53:01Z',
 'fuel_type': 'petrol',
 'id': '2e5e7e3d-e74a-5e19-b772-b83321e8d3f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA78994',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 166704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-11',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-30 05:37:05 [auto1.de] INFO: Saving data for XA78994: {'auction_closing_time': 1774885981.0, 'created_time': 1774549897.701318, 'last_price_update_time': 1774849025.303731}
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA78994') HTTP/1.1" 204 0
2026-03-30 05:37:05 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:05 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 05:37:05 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-30 05:37:05 [auto1.de] INFO: Scrape type for GR47170: 2
2026-03-30 05:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd2dfcb-8f90-5290-8893-2339545c13c0 with identifier: GR47170
2026-03-30 05:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd2dfcb-8f90-5290-8893-2339545c13c0 with scrape type 2
2026-03-30 05:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bd2dfcb-8f90-5290-8893-2339545c13c0 with scrape type 2
2026-03-30 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bd2dfcb-8f90-5290-8893-2339545c13c0, identifier: GR47170
2026-03-30 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bd2dfcb-8f90-5290-8893-2339545c13c0 with identifier: GR47170
2026-03-30 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bd2dfcb-8f90-5290-8893-2339545c13c0 with identifier: GR47170
2026-03-30 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bd2dfcb-8f90-5290-8893-2339545c13c0 with identifier: GR47170 to the API
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'petrol',
 'id': '9bd2dfcb-8f90-5290-8893-2339545c13c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR47170',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 70399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Exclusive-Line',
 'transmission': 'manual',
 'trim': 'Exclusive-Line',
 'year': 2017}
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-30 05:37:05 [auto1.de] INFO: Saving data for GR47170: {'auction_closing_time': 1774884919.0, 'created_time': 1774549857.51057, 'last_price_update_time': 1774849025.69628}
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR47170') HTTP/1.1" 204 0
2026-03-30 05:37:05 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-30 05:37:05 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-30 05:37:05 [auto1.de] INFO: Scrape type for XJ41164: 2
2026-03-30 05:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d0d261-e7e4-5106-aa20-083d6629c162 with identifier: XJ41164
2026-03-30 05:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d0d261-e7e4-5106-aa20-083d6629c162 with scrape type 2
2026-03-30 05:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d0d261-e7e4-5106-aa20-083d6629c162 with scrape type 2
2026-03-30 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06d0d261-e7e4-5106-aa20-083d6629c162, identifier: XJ41164
2026-03-30 05:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:05 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-30 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06d0d261-e7e4-5106-aa20-083d6629c162 with identifier: XJ41164
2026-03-30 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06d0d261-e7e4-5106-aa20-083d6629c162 with identifier: XJ41164
2026-03-30 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06d0d261-e7e4-5106-aa20-083d6629c162 with identifier: XJ41164 to the API
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:01:50Z',
 'fuel_type': 'petrol',
 'id': '06d0d261-e7e4-5106-aa20-083d6629c162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ41164',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 145310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-15',
 'seller_name': None,
 'title': 'Audi Q8 55 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-30 05:37:06 [auto1.de] INFO: Saving data for XJ41164: {'auction_closing_time': 1774882910.0, 'created_time': 1774639143.481026, 'last_price_update_time': 1774849026.105721}
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ41164') HTTP/1.1" 204 0
2026-03-30 05:37:06 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 05:37:06 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-30 05:37:06 [auto1.de] INFO: Scrape type for BP25717: 2
2026-03-30 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-30 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb24744-09b9-5565-8a9d-5dc6a0f4f887 with scrape type 2
2026-03-30 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beb24744-09b9-5565-8a9d-5dc6a0f4f887 with scrape type 2
2026-03-30 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beb24744-09b9-5565-8a9d-5dc6a0f4f887, identifier: BP25717
2026-03-30 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-30 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717
2026-03-30 05:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beb24744-09b9-5565-8a9d-5dc6a0f4f887 with identifier: BP25717 to the API
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:04Z',
 'fuel_type': 'petrol',
 'id': 'beb24744-09b9-5565-8a9d-5dc6a0f4f887',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP25717',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 11068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-30 05:37:06 [auto1.de] INFO: Saving data for BP25717: {'auction_closing_time': 1774883824.0, 'created_time': 1773307624.107882, 'last_price_update_time': 1774849026.620454}
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP25717') HTTP/1.1" 204 0
2026-03-30 05:37:06 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-30 05:37:06 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-30 05:37:06 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-30 05:37:06 [auto1.de] INFO: Scrape type for EV16310: 2
2026-03-30 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 397a6104-0bd5-538f-9c15-3d229a271993 with identifier: EV16310
2026-03-30 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 397a6104-0bd5-538f-9c15-3d229a271993 with scrape type 2
2026-03-30 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 397a6104-0bd5-538f-9c15-3d229a271993 with scrape type 2
2026-03-30 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 397a6104-0bd5-538f-9c15-3d229a271993, identifier: EV16310
2026-03-30 05:37:06 [scrapy.extensions.logstats] INFO: Crawled 86 pages (at 11 pages/min), scraped 494 items (at 86 items/min)
2026-03-30 05:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 397a6104-0bd5-538f-9c15-3d229a271993 with identifier: EV16310
2026-03-30 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 397a6104-0bd5-538f-9c15-3d229a271993 with identifier: EV16310
2026-03-30 05:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 397a6104-0bd5-538f-9c15-3d229a271993 with identifier: EV16310 to the API
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:02:30Z',
 'fuel_type': 'petrol',
 'id': '397a6104-0bd5-538f-9c15-3d229a271993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV16310',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2019}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Saving data for EV16310: {'auction_closing_time': 1774882950.0, 'created_time': 1774636552.087864, 'last_price_update_time': 1774849027.030956}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV16310') HTTP/1.1" 204 0
2026-03-30 05:37:07 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Scrape type for WY50378: 2
2026-03-30 05:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with identifier: WY50378
2026-03-30 05:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with scrape type 2
2026-03-30 05:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with scrape type 2
2026-03-30 05:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e9ae914-8d10-51ad-b0e2-12edafcda7d9, identifier: WY50378
2026-03-30 05:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with identifier: WY50378
2026-03-30 05:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with identifier: WY50378
2026-03-30 05:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e9ae914-8d10-51ad-b0e2-12edafcda7d9 with identifier: WY50378 to the API
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'diesel',
 'id': '6e9ae914-8d10-51ad-b0e2-12edafcda7d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY50378',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 340747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 200 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Saving data for WY50378: {'auction_closing_time': 1774885936.0, 'created_time': 1774639023.517599, 'last_price_update_time': 1774849027.428932}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY50378') HTTP/1.1" 204 0
2026-03-30 05:37:07 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Scrape type for WE11389: 2
2026-03-30 05:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with identifier: WE11389
2026-03-30 05:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with scrape type 2
2026-03-30 05:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with scrape type 2
2026-03-30 05:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0, identifier: WE11389
2026-03-30 05:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with identifier: WE11389
2026-03-30 05:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with identifier: WE11389
2026-03-30 05:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0 with identifier: WE11389 to the API
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:56:54Z',
 'fuel_type': 'diesel',
 'id': 'c7c018e3-6e01-57b0-bb5d-c9e68fbc27c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE11389',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 113184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Saving data for WE11389: {'auction_closing_time': 1774886214.0, 'created_time': 1774636549.192948, 'last_price_update_time': 1774849027.867775}
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE11389') HTTP/1.1" 204 0
2026-03-30 05:37:07 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-30 05:37:07 [auto1.de] INFO: Scrape type for CK35752: 2
2026-03-30 05:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with identifier: CK35752
2026-03-30 05:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with scrape type 2
2026-03-30 05:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with scrape type 2
2026-03-30 05:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d2b2093-550d-5ee0-a92d-5053b9fdb548, identifier: CK35752
2026-03-30 05:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with identifier: CK35752
2026-03-30 05:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with identifier: CK35752
2026-03-30 05:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d2b2093-550d-5ee0-a92d-5053b9fdb548 with identifier: CK35752 to the API
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:49:03Z',
 'fuel_type': 'petrol',
 'id': '7d2b2093-550d-5ee0-a92d-5053b9fdb548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK35752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 57577,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-30 05:37:08 [auto1.de] INFO: Saving data for CK35752: {'auction_closing_time': 1774885743.0, 'created_time': 1774349226.299271, 'last_price_update_time': 1774849028.292249}
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK35752') HTTP/1.1" 204 0
2026-03-30 05:37:08 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-30 05:37:08 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-30 05:37:08 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-30 05:37:08 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-30 05:37:08 [auto1.de] INFO: Scrape type for DD29565: 2
2026-03-30 05:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac228c5-0e6a-510d-a48c-307856532bbf with identifier: DD29565
2026-03-30 05:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac228c5-0e6a-510d-a48c-307856532bbf with scrape type 2
2026-03-30 05:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac228c5-0e6a-510d-a48c-307856532bbf with scrape type 2
2026-03-30 05:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ac228c5-0e6a-510d-a48c-307856532bbf, identifier: DD29565
2026-03-30 05:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ac228c5-0e6a-510d-a48c-307856532bbf with identifier: DD29565
2026-03-30 05:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ac228c5-0e6a-510d-a48c-307856532bbf with identifier: DD29565
2026-03-30 05:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ac228c5-0e6a-510d-a48c-307856532bbf with identifier: DD29565 to the API
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:28:15Z',
 'fuel_type': 'diesel',
 'id': '7ac228c5-0e6a-510d-a48c-307856532bbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD29565',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 266636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-13',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'manual',
 'trim': 'xDrive',
 'year': 2011}
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-30 05:37:08 [auto1.de] INFO: Saving data for DD29565: {'auction_closing_time': 1774884495.0, 'created_time': 1773131996.31218, 'last_price_update_time': 1774849028.696414}
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD29565') HTTP/1.1" 204 0
2026-03-30 05:37:08 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-30 05:37:08 [auto1.de] INFO: Scrape type for MW86631: 2
2026-03-30 05:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908177ed-7696-5bdb-8591-2f57fad9945a with identifier: MW86631
2026-03-30 05:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908177ed-7696-5bdb-8591-2f57fad9945a with scrape type 2
2026-03-30 05:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908177ed-7696-5bdb-8591-2f57fad9945a with scrape type 2
2026-03-30 05:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 908177ed-7696-5bdb-8591-2f57fad9945a, identifier: MW86631
2026-03-30 05:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 908177ed-7696-5bdb-8591-2f57fad9945a with identifier: MW86631
2026-03-30 05:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 908177ed-7696-5bdb-8591-2f57fad9945a with identifier: MW86631
2026-03-30 05:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 908177ed-7696-5bdb-8591-2f57fad9945a with identifier: MW86631 to the API
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'diesel',
 'id': '908177ed-7696-5bdb-8591-2f57fad9945a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW86631',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 232642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2013}
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Saving data for MW86631: {'auction_closing_time': 1774883862.0, 'created_time': 1774637098.541279, 'last_price_update_time': 1774849029.197294}
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW86631') HTTP/1.1" 204 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for PK93112: 2
2026-03-30 05:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1114634f-fdd5-5211-b254-b395eef8699b with identifier: PK93112
2026-03-30 05:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1114634f-fdd5-5211-b254-b395eef8699b with scrape type 2
2026-03-30 05:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1114634f-fdd5-5211-b254-b395eef8699b with scrape type 2
2026-03-30 05:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1114634f-fdd5-5211-b254-b395eef8699b, identifier: PK93112
2026-03-30 05:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1114634f-fdd5-5211-b254-b395eef8699b with identifier: PK93112
2026-03-30 05:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1114634f-fdd5-5211-b254-b395eef8699b with identifier: PK93112
2026-03-30 05:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1114634f-fdd5-5211-b254-b395eef8699b with identifier: PK93112 to the API
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:25:57Z',
 'fuel_type': 'petrol',
 'id': '1114634f-fdd5-5211-b254-b395eef8699b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK93112',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 93300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-19',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo 120 Jahre ecoFlex',
 'transmission': 'manual',
 'trim': '120 Jahre ecoFlex',
 'year': 2019}
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Saving data for PK93112: {'auction_closing_time': 1774884357.0, 'created_time': 1774637930.89274, 'last_price_update_time': 1774849029.659594}
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK93112') HTTP/1.1" 204 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for YT53234: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for TH77412: 0
2026-03-30 05:37:09 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-30 05:37:09 [auto1.de] INFO: Scrape type for MS75707: 2
2026-03-30 05:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-30 05:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19d6518-c79e-5e63-b444-b62a9e53ea97 with scrape type 2
2026-03-30 05:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19d6518-c79e-5e63-b444-b62a9e53ea97 with scrape type 2
2026-03-30 05:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e19d6518-c79e-5e63-b444-b62a9e53ea97, identifier: MS75707
2026-03-30 05:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-30 05:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707
2026-03-30 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e19d6518-c79e-5e63-b444-b62a9e53ea97 with identifier: MS75707 to the API
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:47:59Z',
 'fuel_type': 'diesel',
 'id': 'e19d6518-c79e-5e63-b444-b62a9e53ea97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS75707',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 200525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-30 05:37:10 [auto1.de] INFO: Saving data for MS75707: {'auction_closing_time': 1774885679.0, 'created_time': 1774550532.497225, 'last_price_update_time': 1774849030.24555}
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS75707') HTTP/1.1" 204 0
2026-03-30 05:37:10 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-30 05:37:10 [auto1.de] INFO: Scrape type for CH79941: 2
2026-03-30 05:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01b0c753-b863-56a3-bf31-a4b643fbcedb with identifier: CH79941
2026-03-30 05:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01b0c753-b863-56a3-bf31-a4b643fbcedb with scrape type 2
2026-03-30 05:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01b0c753-b863-56a3-bf31-a4b643fbcedb with scrape type 2
2026-03-30 05:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01b0c753-b863-56a3-bf31-a4b643fbcedb, identifier: CH79941
2026-03-30 05:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01b0c753-b863-56a3-bf31-a4b643fbcedb with identifier: CH79941
2026-03-30 05:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01b0c753-b863-56a3-bf31-a4b643fbcedb with identifier: CH79941
2026-03-30 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01b0c753-b863-56a3-bf31-a4b643fbcedb with identifier: CH79941 to the API
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:19:59Z',
 'fuel_type': 'diesel',
 'id': '01b0c753-b863-56a3-bf31-a4b643fbcedb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH79941',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 214125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-22',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-30 05:37:10 [auto1.de] INFO: Saving data for CH79941: {'auction_closing_time': 1774883999.0, 'created_time': 1774637504.085206, 'last_price_update_time': 1774849030.744238}
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH79941') HTTP/1.1" 204 0
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-30 05:37:10 [auto1.de] INFO: Scrape type for SZ55877: 0
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-30 05:37:10 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-30 05:37:10 [auto1.de] INFO: Scrape type for ZZ62402: 2
2026-03-30 05:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3d393c1-d84e-5b6e-8805-09a19c827ced with identifier: ZZ62402
2026-03-30 05:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3d393c1-d84e-5b6e-8805-09a19c827ced with scrape type 2
2026-03-30 05:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3d393c1-d84e-5b6e-8805-09a19c827ced with scrape type 2
2026-03-30 05:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3d393c1-d84e-5b6e-8805-09a19c827ced, identifier: ZZ62402
2026-03-30 05:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3d393c1-d84e-5b6e-8805-09a19c827ced with identifier: ZZ62402
2026-03-30 05:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3d393c1-d84e-5b6e-8805-09a19c827ced with identifier: ZZ62402
2026-03-30 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3d393c1-d84e-5b6e-8805-09a19c827ced with identifier: ZZ62402 to the API
2026-03-30 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:06:54Z',
 'fuel_type': 'hybrid',
 'id': 'e3d393c1-d84e-5b6e-8805-09a19c827ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ62402',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 123771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Audi A6 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-30 05:37:11 [auto1.de] INFO: Saving data for ZZ62402: {'auction_closing_time': 1774883214.0, 'created_time': 1774637763.93371, 'last_price_update_time': 1774849031.158065}
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ62402') HTTP/1.1" 204 0
2026-03-30 05:37:11 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-30 05:37:11 [auto1.de] INFO: Scrape type for BX70846: 2
2026-03-30 05:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with identifier: BX70846
2026-03-30 05:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with scrape type 2
2026-03-30 05:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with scrape type 2
2026-03-30 05:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d31e11c-1f6e-596b-98d5-1709c2b7c84f, identifier: BX70846
2026-03-30 05:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with identifier: BX70846
2026-03-30 05:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with identifier: BX70846
2026-03-30 05:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d31e11c-1f6e-596b-98d5-1709c2b7c84f with identifier: BX70846 to the API
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:01:33Z',
 'fuel_type': 'diesel',
 'id': '1d31e11c-1f6e-596b-98d5-1709c2b7c84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX70846',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 309770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-30 05:37:11 [auto1.de] INFO: Saving data for BX70846: {'auction_closing_time': 1774882893.0, 'created_time': 1773945775.532802, 'last_price_update_time': 1774849031.632998}
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX70846') HTTP/1.1" 204 0
2026-03-30 05:37:11 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-30 05:37:11 [auto1.de] INFO: Scrape type for SD59172: 2
2026-03-30 05:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46461776-2420-5edb-871b-03faf200362b with identifier: SD59172
2026-03-30 05:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46461776-2420-5edb-871b-03faf200362b with scrape type 2
2026-03-30 05:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46461776-2420-5edb-871b-03faf200362b with scrape type 2
2026-03-30 05:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46461776-2420-5edb-871b-03faf200362b, identifier: SD59172
2026-03-30 05:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46461776-2420-5edb-871b-03faf200362b with identifier: SD59172
2026-03-30 05:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46461776-2420-5edb-871b-03faf200362b with identifier: SD59172
2026-03-30 05:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46461776-2420-5edb-871b-03faf200362b with identifier: SD59172 to the API
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 335,
 'expiration_date': '2026-03-30T15:30:58Z',
 'fuel_type': 'petrol',
 'id': '46461776-2420-5edb-871b-03faf200362b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD59172',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 161540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-18',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 4.2 V8 4Motion',
 'transmission': 'automatic',
 'trim': '4Motion',
 'year': 2013}
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Saving data for SD59172: {'auction_closing_time': 1774884658.0, 'created_time': 1774549868.289981, 'last_price_update_time': 1774849032.057336}
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD59172') HTTP/1.1" 204 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for SR59541: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for GJ71722: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for HV44481: 2
2026-03-30 05:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3df38ce-1808-5a11-a3d3-4cc90f172a3d with identifier: HV44481
2026-03-30 05:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3df38ce-1808-5a11-a3d3-4cc90f172a3d with scrape type 2
2026-03-30 05:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3df38ce-1808-5a11-a3d3-4cc90f172a3d with scrape type 2
2026-03-30 05:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3df38ce-1808-5a11-a3d3-4cc90f172a3d, identifier: HV44481
2026-03-30 05:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3df38ce-1808-5a11-a3d3-4cc90f172a3d with identifier: HV44481
2026-03-30 05:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3df38ce-1808-5a11-a3d3-4cc90f172a3d with identifier: HV44481
2026-03-30 05:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3df38ce-1808-5a11-a3d3-4cc90f172a3d with identifier: HV44481 to the API
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:58:28Z',
 'fuel_type': 'petrol',
 'id': 'b3df38ce-1808-5a11-a3d3-4cc90f172a3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV44481',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 150505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-29',
 'seller_name': None,
 'title': 'BMW 5er 520i Lifestyle',
 'transmission': 'manual',
 'trim': 'Lifestyle',
 'year': 2003}
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Saving data for HV44481: {'auction_closing_time': 1774886308.0, 'created_time': 1774638404.486348, 'last_price_update_time': 1774849032.54868}
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV44481') HTTP/1.1" 204 0
2026-03-30 05:37:12 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-30 05:37:12 [auto1.de] INFO: Scrape type for CR35436: 2
2026-03-30 05:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 097d52ad-17ab-5de2-87da-4836c5f84282 with identifier: CR35436
2026-03-30 05:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 097d52ad-17ab-5de2-87da-4836c5f84282 with scrape type 2
2026-03-30 05:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 097d52ad-17ab-5de2-87da-4836c5f84282 with scrape type 2
2026-03-30 05:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 097d52ad-17ab-5de2-87da-4836c5f84282, identifier: CR35436
2026-03-30 05:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 097d52ad-17ab-5de2-87da-4836c5f84282 with identifier: CR35436
2026-03-30 05:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 097d52ad-17ab-5de2-87da-4836c5f84282 with identifier: CR35436
2026-03-30 05:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 097d52ad-17ab-5de2-87da-4836c5f84282 with identifier: CR35436 to the API
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:29:58Z',
 'fuel_type': 'petrol',
 'id': '097d52ad-17ab-5de2-87da-4836c5f84282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR35436',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 100192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Saving data for CR35436: {'auction_closing_time': 1774884598.0, 'created_time': 1774639335.162395, 'last_price_update_time': 1774849033.074799}
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR35436') HTTP/1.1" 204 0
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Scrape type for HW53715: 0
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Scrape type for SU06279: 0
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Scrape type for HR44152: 2
2026-03-30 05:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-30 05:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aed92b33-2167-5eec-b130-54903dbdde14 with scrape type 2
2026-03-30 05:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aed92b33-2167-5eec-b130-54903dbdde14 with scrape type 2
2026-03-30 05:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aed92b33-2167-5eec-b130-54903dbdde14, identifier: HR44152
2026-03-30 05:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-30 05:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152
2026-03-30 05:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aed92b33-2167-5eec-b130-54903dbdde14 with identifier: HR44152 to the API
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:41:20Z',
 'fuel_type': 'petrol',
 'id': 'aed92b33-2167-5eec-b130-54903dbdde14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR44152',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 137292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-29',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Saving data for HR44152: {'auction_closing_time': 1774885280.0, 'created_time': 1774552534.322653, 'last_price_update_time': 1774849033.529469}
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR44152') HTTP/1.1" 204 0
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 05:37:13 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-30 05:37:13 [auto1.de] INFO: Scrape type for YS01662: 2
2026-03-30 05:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6570658-fa79-531d-9010-13e63f47255f with identifier: YS01662
2026-03-30 05:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6570658-fa79-531d-9010-13e63f47255f with scrape type 2
2026-03-30 05:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6570658-fa79-531d-9010-13e63f47255f with scrape type 2
2026-03-30 05:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6570658-fa79-531d-9010-13e63f47255f, identifier: YS01662
2026-03-30 05:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6570658-fa79-531d-9010-13e63f47255f with identifier: YS01662
2026-03-30 05:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6570658-fa79-531d-9010-13e63f47255f with identifier: YS01662
2026-03-30 05:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6570658-fa79-531d-9010-13e63f47255f with identifier: YS01662 to the API
2026-03-30 05:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:46:01Z',
 'fuel_type': 'diesel',
 'id': 'c6570658-fa79-531d-9010-13e63f47255f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS01662',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 96160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-22',
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-30 05:37:14 [auto1.de] INFO: Saving data for YS01662: {'auction_closing_time': 1774885561.0, 'created_time': 1773946475.841302, 'last_price_update_time': 1774849034.706034}
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS01662') HTTP/1.1" 204 0
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 05:37:14 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-30 05:37:14 [auto1.de] INFO: Scrape type for DL45560: 2
2026-03-30 05:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f112bce-6f8a-5274-a788-fb93fad7b6fb with identifier: DL45560
2026-03-30 05:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f112bce-6f8a-5274-a788-fb93fad7b6fb with scrape type 2
2026-03-30 05:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f112bce-6f8a-5274-a788-fb93fad7b6fb with scrape type 2
2026-03-30 05:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f112bce-6f8a-5274-a788-fb93fad7b6fb, identifier: DL45560
2026-03-30 05:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f112bce-6f8a-5274-a788-fb93fad7b6fb with identifier: DL45560
2026-03-30 05:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f112bce-6f8a-5274-a788-fb93fad7b6fb with identifier: DL45560
2026-03-30 05:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f112bce-6f8a-5274-a788-fb93fad7b6fb with identifier: DL45560 to the API
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:39Z',
 'fuel_type': 'petrol',
 'id': '6f112bce-6f8a-5274-a788-fb93fad7b6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL45560',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 98657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2011}
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-30 05:37:15 [auto1.de] INFO: Saving data for DL45560: {'auction_closing_time': 1774883439.0, 'created_time': 1774639302.061614, 'last_price_update_time': 1774849035.227957}
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL45560') HTTP/1.1" 204 0
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-30 05:37:15 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 05:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:15 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-30 05:37:15 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-30 05:37:15 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-30 05:37:15 [auto1.de] INFO: Scrape type for GC28656: 2
2026-03-30 05:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4828360-8db5-5997-8985-24c9af661209 with identifier: GC28656
2026-03-30 05:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4828360-8db5-5997-8985-24c9af661209 with scrape type 2
2026-03-30 05:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4828360-8db5-5997-8985-24c9af661209 with scrape type 2
2026-03-30 05:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4828360-8db5-5997-8985-24c9af661209, identifier: GC28656
2026-03-30 05:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4828360-8db5-5997-8985-24c9af661209 with identifier: GC28656
2026-03-30 05:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4828360-8db5-5997-8985-24c9af661209 with identifier: GC28656
2026-03-30 05:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4828360-8db5-5997-8985-24c9af661209 with identifier: GC28656 to the API
2026-03-30 05:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:59Z',
 'fuel_type': 'petrol',
 'id': 'f4828360-8db5-5997-8985-24c9af661209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC28656',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 109303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-24',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Saving data for GC28656: {'auction_closing_time': 1774884179.0, 'created_time': 1774639260.477152, 'last_price_update_time': 1774849036.138938}
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC28656') HTTP/1.1" 204 0
2026-03-30 05:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Scrape type for BV81502: 2
2026-03-30 05:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90ad94f-0d6c-5484-9447-ee077a44ba9c with identifier: BV81502
2026-03-30 05:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90ad94f-0d6c-5484-9447-ee077a44ba9c with scrape type 2
2026-03-30 05:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90ad94f-0d6c-5484-9447-ee077a44ba9c with scrape type 2
2026-03-30 05:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90ad94f-0d6c-5484-9447-ee077a44ba9c, identifier: BV81502
2026-03-30 05:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90ad94f-0d6c-5484-9447-ee077a44ba9c with identifier: BV81502
2026-03-30 05:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90ad94f-0d6c-5484-9447-ee077a44ba9c with identifier: BV81502
2026-03-30 05:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90ad94f-0d6c-5484-9447-ee077a44ba9c with identifier: BV81502 to the API
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:51Z',
 'fuel_type': 'diesel',
 'id': 'f90ad94f-0d6c-5484-9447-ee077a44ba9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV81502',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 221771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Navi',
 'transmission': 'manual',
 'trim': 'Navi',
 'year': 2008}
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Saving data for BV81502: {'auction_closing_time': 1774886391.0, 'created_time': 1774636741.681165, 'last_price_update_time': 1774849036.638404}
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV81502') HTTP/1.1" 204 0
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Scrape type for AK58988: 0
2026-03-30 05:37:16 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-30 05:37:16 [auto1.de] INFO: Scrape type for HR13595: 2
2026-03-30 05:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4976946c-27d2-532e-be11-c3c8eabe4fcc with identifier: HR13595
2026-03-30 05:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4976946c-27d2-532e-be11-c3c8eabe4fcc with scrape type 2
2026-03-30 05:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4976946c-27d2-532e-be11-c3c8eabe4fcc with scrape type 2
2026-03-30 05:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4976946c-27d2-532e-be11-c3c8eabe4fcc, identifier: HR13595
2026-03-30 05:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4976946c-27d2-532e-be11-c3c8eabe4fcc with identifier: HR13595
2026-03-30 05:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4976946c-27d2-532e-be11-c3c8eabe4fcc with identifier: HR13595
2026-03-30 05:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4976946c-27d2-532e-be11-c3c8eabe4fcc with identifier: HR13595 to the API
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:15:11Z',
 'fuel_type': 'petrol',
 'id': '4976946c-27d2-532e-be11-c3c8eabe4fcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR13595',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 84159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-13',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Saving data for HR13595: {'auction_closing_time': 1774883711.0, 'created_time': 1774639439.234586, 'last_price_update_time': 1774849037.060878}
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR13595') HTTP/1.1" 204 0
2026-03-30 05:37:17 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-30 05:37:17 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-30 05:37:17 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-30 05:37:17 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Scrape type for FC75041: 2
2026-03-30 05:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a213dcaf-a834-57b7-9d25-5a1d44c59d78 with identifier: FC75041
2026-03-30 05:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a213dcaf-a834-57b7-9d25-5a1d44c59d78 with scrape type 2
2026-03-30 05:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a213dcaf-a834-57b7-9d25-5a1d44c59d78 with scrape type 2
2026-03-30 05:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a213dcaf-a834-57b7-9d25-5a1d44c59d78, identifier: FC75041
2026-03-30 05:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a213dcaf-a834-57b7-9d25-5a1d44c59d78 with identifier: FC75041
2026-03-30 05:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a213dcaf-a834-57b7-9d25-5a1d44c59d78 with identifier: FC75041
2026-03-30 05:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a213dcaf-a834-57b7-9d25-5a1d44c59d78 with identifier: FC75041 to the API
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:02:34Z',
 'fuel_type': 'diesel',
 'id': 'a213dcaf-a834-57b7-9d25-5a1d44c59d78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC75041',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 142934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Saving data for FC75041: {'auction_closing_time': 1774882954.0, 'created_time': 1774639173.391064, 'last_price_update_time': 1774849037.498457}
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC75041') HTTP/1.1" 204 0
2026-03-30 05:37:17 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Scrape type for PP85770: 2
2026-03-30 05:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-30 05:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with scrape type 2
2026-03-30 05:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with scrape type 2
2026-03-30 05:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7546b83f-d9c7-53eb-ab21-e2945c033dd0, identifier: PP85770
2026-03-30 05:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-30 05:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770
2026-03-30 05:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7546b83f-d9c7-53eb-ab21-e2945c033dd0 with identifier: PP85770 to the API
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-30T15:23:58Z',
 'fuel_type': 'petrol',
 'id': '7546b83f-d9c7-53eb-ab21-e2945c033dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP85770',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 34648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-13',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 MPI Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2020}
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-30 05:37:17 [auto1.de] INFO: Saving data for PP85770: {'auction_closing_time': 1774884238.0, 'created_time': 1774552662.571389, 'last_price_update_time': 1774849037.995973}
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP85770') HTTP/1.1" 204 0
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Scrape type for VY07286: 2
2026-03-30 05:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-30 05:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca, identifier: VY07286
2026-03-30 05:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-30 05:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286
2026-03-30 05:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca with identifier: VY07286 to the API
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:41:48Z',
 'fuel_type': 'petrol',
 'id': 'c9daf4d4-b5e3-5eb9-b09b-ce6eb869b1ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY07286',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 45780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2018}
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Saving data for VY07286: {'auction_closing_time': 1774885308.0, 'created_time': 1774552706.845603, 'last_price_update_time': 1774849038.405894}
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY07286') HTTP/1.1" 204 0
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Scrape type for KP81674: 2
2026-03-30 05:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ca1603-a809-537b-a91c-21d3ff0881c5 with identifier: KP81674
2026-03-30 05:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ca1603-a809-537b-a91c-21d3ff0881c5 with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ca1603-a809-537b-a91c-21d3ff0881c5 with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ca1603-a809-537b-a91c-21d3ff0881c5, identifier: KP81674
2026-03-30 05:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ca1603-a809-537b-a91c-21d3ff0881c5 with identifier: KP81674
2026-03-30 05:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ca1603-a809-537b-a91c-21d3ff0881c5 with identifier: KP81674
2026-03-30 05:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ca1603-a809-537b-a91c-21d3ff0881c5 with identifier: KP81674 to the API
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:30:39Z',
 'fuel_type': 'diesel',
 'id': '26ca1603-a809-537b-a91c-21d3ff0881c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP81674',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 98648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Saving data for KP81674: {'auction_closing_time': 1774884639.0, 'created_time': 1773137492.332449, 'last_price_update_time': 1774849038.820642}
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP81674') HTTP/1.1" 204 0
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 05:37:18 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-30 05:37:18 [auto1.de] INFO: Scrape type for JN06918: 2
2026-03-30 05:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378f842f-0130-576d-a06d-d8df016f8b3a with identifier: JN06918
2026-03-30 05:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378f842f-0130-576d-a06d-d8df016f8b3a with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 378f842f-0130-576d-a06d-d8df016f8b3a with scrape type 2
2026-03-30 05:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 378f842f-0130-576d-a06d-d8df016f8b3a, identifier: JN06918
2026-03-30 05:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 378f842f-0130-576d-a06d-d8df016f8b3a with identifier: JN06918
2026-03-30 05:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 378f842f-0130-576d-a06d-d8df016f8b3a with identifier: JN06918
2026-03-30 05:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 378f842f-0130-576d-a06d-d8df016f8b3a with identifier: JN06918 to the API
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:37Z',
 'fuel_type': 'petrol',
 'id': '378f842f-0130-576d-a06d-d8df016f8b3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN06918',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 276740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-01',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 CATCH ME Now',
 'transmission': 'manual',
 'trim': 'CATCH ME Now',
 'year': 2008}
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Saving data for JN06918: {'auction_closing_time': 1774886197.0, 'created_time': 1774636737.173976, 'last_price_update_time': 1774849039.24564}
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN06918') HTTP/1.1" 204 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-30 05:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:19 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for ZJ39351: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-30 05:37:19 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-30 05:37:19 [auto1.de] INFO: Scrape type for WY11895: 2
2026-03-30 05:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56da22d4-2529-57a3-9142-bf941cde67fe with identifier: WY11895
2026-03-30 05:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56da22d4-2529-57a3-9142-bf941cde67fe with scrape type 2
2026-03-30 05:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56da22d4-2529-57a3-9142-bf941cde67fe with scrape type 2
2026-03-30 05:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56da22d4-2529-57a3-9142-bf941cde67fe, identifier: WY11895
2026-03-30 05:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56da22d4-2529-57a3-9142-bf941cde67fe with identifier: WY11895
2026-03-30 05:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56da22d4-2529-57a3-9142-bf941cde67fe with identifier: WY11895
2026-03-30 05:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56da22d4-2529-57a3-9142-bf941cde67fe with identifier: WY11895 to the API
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'diesel',
 'id': '56da22d4-2529-57a3-9142-bf941cde67fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY11895',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 98476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Saving data for WY11895: {'auction_closing_time': 1774885333.0, 'created_time': 1774639333.695802, 'last_price_update_time': 1774849040.051122}
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY11895') HTTP/1.1" 204 0
2026-03-30 05:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Scrape type for LC91411: 0
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Scrape type for UW78098: 2
2026-03-30 05:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef227e7f-2d54-5532-b024-ee84fa0a1795 with identifier: UW78098
2026-03-30 05:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef227e7f-2d54-5532-b024-ee84fa0a1795 with scrape type 2
2026-03-30 05:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef227e7f-2d54-5532-b024-ee84fa0a1795 with scrape type 2
2026-03-30 05:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef227e7f-2d54-5532-b024-ee84fa0a1795, identifier: UW78098
2026-03-30 05:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef227e7f-2d54-5532-b024-ee84fa0a1795 with identifier: UW78098
2026-03-30 05:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef227e7f-2d54-5532-b024-ee84fa0a1795 with identifier: UW78098
2026-03-30 05:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef227e7f-2d54-5532-b024-ee84fa0a1795 with identifier: UW78098 to the API
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:12Z',
 'fuel_type': 'petrol',
 'id': 'ef227e7f-2d54-5532-b024-ee84fa0a1795',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW78098',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space',
 'odometer': 177662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-15',
 'seller_name': None,
 'title': 'Mitsubishi Space 2.4 GDI Avance',
 'transmission': 'manual',
 'trim': 'Avance',
 'year': 2007}
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Saving data for UW78098: {'auction_closing_time': 1774883172.0, 'created_time': 1773427408.926563, 'last_price_update_time': 1774849040.621804}
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW78098') HTTP/1.1" 204 0
2026-03-30 05:37:20 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-30 05:37:20 [auto1.de] INFO: Scrape type for AE84214: 2
2026-03-30 05:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with identifier: AE84214
2026-03-30 05:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with scrape type 2
2026-03-30 05:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with scrape type 2
2026-03-30 05:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac1cb902-90b9-5264-9c4f-f7a6f71a0df5, identifier: AE84214
2026-03-30 05:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with identifier: AE84214
2026-03-30 05:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with identifier: AE84214
2026-03-30 05:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac1cb902-90b9-5264-9c4f-f7a6f71a0df5 with identifier: AE84214 to the API
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:58Z',
 'fuel_type': 'petrol',
 'id': 'ac1cb902-90b9-5264-9c4f-f7a6f71a0df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE84214',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 185553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Saving data for AE84214: {'auction_closing_time': 1774885558.0, 'created_time': 1773427448.139988, 'last_price_update_time': 1774849041.027807}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE84214') HTTP/1.1" 204 0
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Scrape type for XU28434: 0
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Scrape type for KD94440: 2
2026-03-30 05:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 028c6c69-249a-5916-8ee1-9472ce9f1720 with identifier: KD94440
2026-03-30 05:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 028c6c69-249a-5916-8ee1-9472ce9f1720 with scrape type 2
2026-03-30 05:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 028c6c69-249a-5916-8ee1-9472ce9f1720 with scrape type 2
2026-03-30 05:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 028c6c69-249a-5916-8ee1-9472ce9f1720, identifier: KD94440
2026-03-30 05:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 028c6c69-249a-5916-8ee1-9472ce9f1720 with identifier: KD94440
2026-03-30 05:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 028c6c69-249a-5916-8ee1-9472ce9f1720 with identifier: KD94440
2026-03-30 05:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 028c6c69-249a-5916-8ee1-9472ce9f1720 with identifier: KD94440 to the API
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:49:39Z',
 'fuel_type': 'petrol',
 'id': '028c6c69-249a-5916-8ee1-9472ce9f1720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD94440',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 110300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2011}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Saving data for KD94440: {'auction_closing_time': 1774885779.0, 'created_time': 1774637126.541832, 'last_price_update_time': 1774849041.533964}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD94440') HTTP/1.1" 204 0
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Scrape type for KL26301: 0
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Scrape type for CV55682: 2
2026-03-30 05:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with identifier: CV55682
2026-03-30 05:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with scrape type 2
2026-03-30 05:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with scrape type 2
2026-03-30 05:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf, identifier: CV55682
2026-03-30 05:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with identifier: CV55682
2026-03-30 05:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with identifier: CV55682
2026-03-30 05:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf with identifier: CV55682 to the API
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:04Z',
 'fuel_type': 'petrol',
 'id': '40bb1e34-9ea9-58b5-bf40-c4e22b9dfeaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV55682',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 41573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-14',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Edition Sport40',
 'transmission': 'automatic',
 'trim': 'Edition Sport40',
 'year': 2021}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Saving data for CV55682: {'auction_closing_time': 1774883164.0, 'created_time': 1774638575.93484, 'last_price_update_time': 1774849041.950929}
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV55682') HTTP/1.1" 204 0
2026-03-30 05:37:21 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-30 05:37:21 [auto1.de] INFO: Scrape type for MR72377: 2
2026-03-30 05:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-30 05:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with scrape type 2
2026-03-30 05:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with scrape type 2
2026-03-30 05:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8, identifier: MR72377
2026-03-30 05:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-30 05:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377
2026-03-30 05:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8 with identifier: MR72377 to the API
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:50Z',
 'fuel_type': 'diesel',
 'id': '2ae615fa-a6c3-564a-ad3c-6d992fc8a6a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR72377',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 169715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Saving data for MR72377: {'auction_closing_time': 1774882970.0, 'created_time': 1774552145.046006, 'last_price_update_time': 1774849042.379269}
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR72377') HTTP/1.1" 204 0
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Scrape type for RZ91984: 2
2026-03-30 05:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c10d448-7b71-501b-a66e-107efb4f43c7 with identifier: RZ91984
2026-03-30 05:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c10d448-7b71-501b-a66e-107efb4f43c7 with scrape type 2
2026-03-30 05:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c10d448-7b71-501b-a66e-107efb4f43c7 with scrape type 2
2026-03-30 05:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c10d448-7b71-501b-a66e-107efb4f43c7, identifier: RZ91984
2026-03-30 05:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c10d448-7b71-501b-a66e-107efb4f43c7 with identifier: RZ91984
2026-03-30 05:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c10d448-7b71-501b-a66e-107efb4f43c7 with identifier: RZ91984
2026-03-30 05:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c10d448-7b71-501b-a66e-107efb4f43c7 with identifier: RZ91984 to the API
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '2c10d448-7b71-501b-a66e-107efb4f43c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ91984',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 99599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-05-30',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 1999}
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Saving data for RZ91984: {'auction_closing_time': 1774885209.0, 'created_time': 1774637133.636429, 'last_price_update_time': 1774849042.960145}
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ91984') HTTP/1.1" 204 0
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-30 05:37:22 [auto1.de] INFO: Scrape type for JU32018: 0
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-30 05:37:22 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-30 05:37:23 [auto1.de] INFO: Scrape type for FJ91980: 2
2026-03-30 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3448c55-284f-5b47-85cd-458b72117f21 with identifier: FJ91980
2026-03-30 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3448c55-284f-5b47-85cd-458b72117f21 with scrape type 2
2026-03-30 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3448c55-284f-5b47-85cd-458b72117f21 with scrape type 2
2026-03-30 05:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3448c55-284f-5b47-85cd-458b72117f21, identifier: FJ91980
2026-03-30 05:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3448c55-284f-5b47-85cd-458b72117f21 with identifier: FJ91980
2026-03-30 05:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3448c55-284f-5b47-85cd-458b72117f21 with identifier: FJ91980
2026-03-30 05:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3448c55-284f-5b47-85cd-458b72117f21 with identifier: FJ91980 to the API
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:39:50Z',
 'fuel_type': 'diesel',
 'id': 'e3448c55-284f-5b47-85cd-458b72117f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ91980',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 95005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'MINI Clubman One D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-30 05:37:23 [auto1.de] INFO: Saving data for FJ91980: {'auction_closing_time': 1774885190.0, 'created_time': 1774637283.103145, 'last_price_update_time': 1774849043.395386}
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ91980') HTTP/1.1" 204 0
2026-03-30 05:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:23 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:23 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-30 05:37:23 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-30 05:37:23 [auto1.de] INFO: Scrape type for RS77004: 2
2026-03-30 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d4eee2-1052-53be-866a-048001d428fe with identifier: RS77004
2026-03-30 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d4eee2-1052-53be-866a-048001d428fe with scrape type 2
2026-03-30 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d4eee2-1052-53be-866a-048001d428fe with scrape type 2
2026-03-30 05:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9d4eee2-1052-53be-866a-048001d428fe, identifier: RS77004
2026-03-30 05:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9d4eee2-1052-53be-866a-048001d428fe with identifier: RS77004
2026-03-30 05:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9d4eee2-1052-53be-866a-048001d428fe with identifier: RS77004
2026-03-30 05:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9d4eee2-1052-53be-866a-048001d428fe with identifier: RS77004 to the API
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-30T15:07:52Z',
 'fuel_type': 'diesel',
 'id': 'c9d4eee2-1052-53be-866a-048001d428fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS77004',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 106377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Energy Mild-Hybrid Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-30 05:37:23 [auto1.de] INFO: Saving data for RS77004: {'auction_closing_time': 1774883272.0, 'created_time': 1773228106.384665, 'last_price_update_time': 1774849043.93406}
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS77004') HTTP/1.1" 204 0
2026-03-30 05:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for TV33488: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for SJ47682: 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for CG28709: 2
2026-03-30 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0472c97c-65f8-5659-8dfe-2fb86737eeac with identifier: CG28709
2026-03-30 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0472c97c-65f8-5659-8dfe-2fb86737eeac with scrape type 2
2026-03-30 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0472c97c-65f8-5659-8dfe-2fb86737eeac with scrape type 2
2026-03-30 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0472c97c-65f8-5659-8dfe-2fb86737eeac, identifier: CG28709
2026-03-30 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0472c97c-65f8-5659-8dfe-2fb86737eeac with identifier: CG28709
2026-03-30 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0472c97c-65f8-5659-8dfe-2fb86737eeac with identifier: CG28709
2026-03-30 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0472c97c-65f8-5659-8dfe-2fb86737eeac with identifier: CG28709 to the API
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:00:14Z',
 'fuel_type': 'petrol',
 'id': '0472c97c-65f8-5659-8dfe-2fb86737eeac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG28709',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 79428,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Saving data for CG28709: {'auction_closing_time': 1774882814.0, 'created_time': 1774639214.744039, 'last_price_update_time': 1774849044.590117}
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG28709') HTTP/1.1" 204 0
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-30 05:37:24 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-30 05:37:24 [auto1.de] INFO: Scrape type for XX76692: 2
2026-03-30 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-30 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf84834-7e36-5442-b103-6cca30555594 with scrape type 2
2026-03-30 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf84834-7e36-5442-b103-6cca30555594 with scrape type 2
2026-03-30 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf84834-7e36-5442-b103-6cca30555594, identifier: XX76692
2026-03-30 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-30 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692
2026-03-30 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf84834-7e36-5442-b103-6cca30555594 with identifier: XX76692 to the API
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:40:26Z',
 'fuel_type': 'diesel',
 'id': 'bdf84834-7e36-5442-b103-6cca30555594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX76692',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 324257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2014}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Saving data for XX76692: {'auction_closing_time': 1774885226.0, 'created_time': 1773945087.443826, 'last_price_update_time': 1774849045.076938}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX76692') HTTP/1.1" 204 0
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Scrape type for BN50743: 2
2026-03-30 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with identifier: BN50743
2026-03-30 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with scrape type 2
2026-03-30 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with scrape type 2
2026-03-30 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebfe312c-4f5a-59ce-bcea-921f2c41bf34, identifier: BN50743
2026-03-30 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with identifier: BN50743
2026-03-30 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with identifier: BN50743
2026-03-30 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebfe312c-4f5a-59ce-bcea-921f2c41bf34 with identifier: BN50743 to the API
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:57:32Z',
 'fuel_type': 'petrol',
 'id': 'ebfe312c-4f5a-59ce-bcea-921f2c41bf34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN50743',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 232555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2010}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Saving data for BN50743: {'auction_closing_time': 1774886252.0, 'created_time': 1773135695.97179, 'last_price_update_time': 1774849045.477842}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN50743') HTTP/1.1" 204 0
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Scrape type for JT24059: 0
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Scrape type for JJ41202: 2
2026-03-30 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with identifier: JJ41202
2026-03-30 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with scrape type 2
2026-03-30 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with scrape type 2
2026-03-30 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9aa052d-4cea-5d14-ab21-fdf7909fbd88, identifier: JJ41202
2026-03-30 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with identifier: JJ41202
2026-03-30 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with identifier: JJ41202
2026-03-30 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9aa052d-4cea-5d14-ab21-fdf7909fbd88 with identifier: JJ41202 to the API
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:55:43Z',
 'fuel_type': 'diesel',
 'id': 'd9aa052d-4cea-5d14-ab21-fdf7909fbd88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ41202',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 126018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Saving data for JJ41202: {'auction_closing_time': 1774886143.0, 'created_time': 1774637178.951439, 'last_price_update_time': 1774849045.90501}
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ41202') HTTP/1.1" 204 0
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-30 05:37:25 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-30 05:37:25 [auto1.de] INFO: Scrape type for WC13471: 2
2026-03-30 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3beb75d6-5ede-57c7-99ba-41e3af205f5a with identifier: WC13471
2026-03-30 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3beb75d6-5ede-57c7-99ba-41e3af205f5a with scrape type 2
2026-03-30 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3beb75d6-5ede-57c7-99ba-41e3af205f5a with scrape type 2
2026-03-30 05:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3beb75d6-5ede-57c7-99ba-41e3af205f5a, identifier: WC13471
2026-03-30 05:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3beb75d6-5ede-57c7-99ba-41e3af205f5a with identifier: WC13471
2026-03-30 05:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3beb75d6-5ede-57c7-99ba-41e3af205f5a with identifier: WC13471
2026-03-30 05:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3beb75d6-5ede-57c7-99ba-41e3af205f5a with identifier: WC13471 to the API
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:46:28Z',
 'fuel_type': 'petrol',
 'id': '3beb75d6-5ede-57c7-99ba-41e3af205f5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC13471',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 127646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Saving data for WC13471: {'auction_closing_time': 1774885588.0, 'created_time': 1774031795.090669, 'last_price_update_time': 1774849046.327503}
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC13471') HTTP/1.1" 204 0
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Scrape type for VH78915: 0
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Scrape type for RP08748: 2
2026-03-30 05:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with identifier: RP08748
2026-03-30 05:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with scrape type 2
2026-03-30 05:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with scrape type 2
2026-03-30 05:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac9c12ca-8e8e-5379-9ba5-cf771eabfe35, identifier: RP08748
2026-03-30 05:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with identifier: RP08748
2026-03-30 05:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with identifier: RP08748
2026-03-30 05:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac9c12ca-8e8e-5379-9ba5-cf771eabfe35 with identifier: RP08748 to the API
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'diesel',
 'id': 'ac9c12ca-8e8e-5379-9ba5-cf771eabfe35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP08748',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 259905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-03',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2022}
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Saving data for RP08748: {'auction_closing_time': 1774883547.0, 'created_time': 1773945830.824787, 'last_price_update_time': 1774849046.76083}
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP08748') HTTP/1.1" 204 0
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-30 05:37:26 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-30 05:37:26 [auto1.de] INFO: Scrape type for TK51417: 2
2026-03-30 05:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48069bfe-fc71-5b66-ba06-eb2ba932122e with identifier: TK51417
2026-03-30 05:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48069bfe-fc71-5b66-ba06-eb2ba932122e with scrape type 2
2026-03-30 05:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48069bfe-fc71-5b66-ba06-eb2ba932122e with scrape type 2
2026-03-30 05:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48069bfe-fc71-5b66-ba06-eb2ba932122e, identifier: TK51417
2026-03-30 05:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48069bfe-fc71-5b66-ba06-eb2ba932122e with identifier: TK51417
2026-03-30 05:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48069bfe-fc71-5b66-ba06-eb2ba932122e with identifier: TK51417
2026-03-30 05:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48069bfe-fc71-5b66-ba06-eb2ba932122e with identifier: TK51417 to the API
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:51:47Z',
 'fuel_type': 'petrol',
 'id': '48069bfe-fc71-5b66-ba06-eb2ba932122e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK51417',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 104586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-26',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Saving data for TK51417: {'auction_closing_time': 1774885907.0, 'created_time': 1774636749.275969, 'last_price_update_time': 1774849047.238615}
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK51417') HTTP/1.1" 204 0
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Scrape type for WG78527: 2
2026-03-30 05:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60eb5f4a-05e6-5162-a023-fee9a9611178 with identifier: WG78527
2026-03-30 05:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60eb5f4a-05e6-5162-a023-fee9a9611178 with scrape type 2
2026-03-30 05:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60eb5f4a-05e6-5162-a023-fee9a9611178 with scrape type 2
2026-03-30 05:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60eb5f4a-05e6-5162-a023-fee9a9611178, identifier: WG78527
2026-03-30 05:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60eb5f4a-05e6-5162-a023-fee9a9611178 with identifier: WG78527
2026-03-30 05:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60eb5f4a-05e6-5162-a023-fee9a9611178 with identifier: WG78527
2026-03-30 05:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60eb5f4a-05e6-5162-a023-fee9a9611178 with identifier: WG78527 to the API
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:42Z',
 'fuel_type': 'petrol',
 'id': '60eb5f4a-05e6-5162-a023-fee9a9611178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG78527',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 56532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-23',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2013}
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Saving data for WG78527: {'auction_closing_time': 1774884402.0, 'created_time': 1774638578.597407, 'last_price_update_time': 1774849047.671272}
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG78527') HTTP/1.1" 204 0
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-30 05:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:27 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-30 05:37:27 [auto1.de] INFO: Scrape type for JD98482: 0
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-30 05:37:27 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for NW77024: 2
2026-03-30 05:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97c4e91f-0eee-5934-8916-34ee85dc8997 with identifier: NW77024
2026-03-30 05:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97c4e91f-0eee-5934-8916-34ee85dc8997 with scrape type 2
2026-03-30 05:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97c4e91f-0eee-5934-8916-34ee85dc8997 with scrape type 2
2026-03-30 05:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97c4e91f-0eee-5934-8916-34ee85dc8997, identifier: NW77024
2026-03-30 05:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97c4e91f-0eee-5934-8916-34ee85dc8997 with identifier: NW77024
2026-03-30 05:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97c4e91f-0eee-5934-8916-34ee85dc8997 with identifier: NW77024
2026-03-30 05:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97c4e91f-0eee-5934-8916-34ee85dc8997 with identifier: NW77024 to the API
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'petrol',
 'id': '97c4e91f-0eee-5934-8916-34ee85dc8997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW77024',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 13525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-06',
 'seller_name': None,
 'title': 'Audi S5 3.0 TFSI Mild-Hybrid quattro edition one',
 'transmission': 'automatic',
 'trim': 'quattro edition one',
 'year': 2025}
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Saving data for NW77024: {'auction_closing_time': 1774884139.0, 'created_time': 1774549918.840995, 'last_price_update_time': 1774849048.40656}
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW77024') HTTP/1.1" 204 0
2026-03-30 05:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-30 05:37:28 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-30 05:37:28 [auto1.de] INFO: Scrape type for GZ30709: 2
2026-03-30 05:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0260bb-8413-56ac-a96f-f4e94a482848 with identifier: GZ30709
2026-03-30 05:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0260bb-8413-56ac-a96f-f4e94a482848 with scrape type 2
2026-03-30 05:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df0260bb-8413-56ac-a96f-f4e94a482848 with scrape type 2
2026-03-30 05:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df0260bb-8413-56ac-a96f-f4e94a482848, identifier: GZ30709
2026-03-30 05:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df0260bb-8413-56ac-a96f-f4e94a482848 with identifier: GZ30709
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 05:37:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df0260bb-8413-56ac-a96f-f4e94a482848 with identifier: GZ30709
2026-03-30 05:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df0260bb-8413-56ac-a96f-f4e94a482848 with identifier: GZ30709 to the API
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:44:52Z',
 'fuel_type': 'petrol',
 'id': 'df0260bb-8413-56ac-a96f-f4e94a482848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ30709',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 83994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-25',
 'seller_name': None,
 'title': 'BMW 3er 330i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-30 05:37:29 [auto1.de] INFO: Saving data for GZ30709: {'auction_closing_time': 1774885492.0, 'created_time': 1773946167.788905, 'last_price_update_time': 1774849049.072009}
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ30709') HTTP/1.1" 204 0
2026-03-30 05:37:29 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-30 05:37:29 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-30 05:37:29 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-30 05:37:29 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-30 05:37:29 [auto1.de] INFO: Scrape type for NC82982: 2
2026-03-30 05:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 882a9b7b-c84e-5d33-a288-281077b3dd1d with identifier: NC82982
2026-03-30 05:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 882a9b7b-c84e-5d33-a288-281077b3dd1d with scrape type 2
2026-03-30 05:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 882a9b7b-c84e-5d33-a288-281077b3dd1d with scrape type 2
2026-03-30 05:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 882a9b7b-c84e-5d33-a288-281077b3dd1d, identifier: NC82982
2026-03-30 05:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 882a9b7b-c84e-5d33-a288-281077b3dd1d with identifier: NC82982
2026-03-30 05:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 882a9b7b-c84e-5d33-a288-281077b3dd1d with identifier: NC82982
2026-03-30 05:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 882a9b7b-c84e-5d33-a288-281077b3dd1d with identifier: NC82982 to the API
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:48Z',
 'fuel_type': 'diesel',
 'id': '882a9b7b-c84e-5d33-a288-281077b3dd1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC82982',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 370718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2012}
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-30 05:37:29 [auto1.de] INFO: Saving data for NC82982: {'auction_closing_time': 1774883268.0, 'created_time': 1774034083.167315, 'last_price_update_time': 1774849049.550055}
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC82982') HTTP/1.1" 204 0
2026-03-30 05:37:29 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-30 05:37:29 [auto1.de] INFO: Scrape type for VZ19342: 2
2026-03-30 05:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-30 05:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b10cb638-6971-5881-9787-b4341c26b445 with scrape type 2
2026-03-30 05:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b10cb638-6971-5881-9787-b4341c26b445 with scrape type 2
2026-03-30 05:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b10cb638-6971-5881-9787-b4341c26b445, identifier: VZ19342
2026-03-30 05:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-30 05:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342
2026-03-30 05:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b10cb638-6971-5881-9787-b4341c26b445 with identifier: VZ19342 to the API
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:45:59Z',
 'fuel_type': 'hybrid',
 'id': 'b10cb638-6971-5881-9787-b4341c26b445',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ19342',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 21540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-02',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Team D',
 'transmission': 'automatic',
 'trim': '2WD Team D',
 'year': 2023}
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Saving data for VZ19342: {'auction_closing_time': 1774885559.0, 'created_time': 1774552104.950086, 'last_price_update_time': 1774849050.070998}
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ19342') HTTP/1.1" 204 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for PV97095: 2
2026-03-30 05:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with identifier: PV97095
2026-03-30 05:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with scrape type 2
2026-03-30 05:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with scrape type 2
2026-03-30 05:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee4f8cb9-c597-5b97-b51a-91cae03c2dbe, identifier: PV97095
2026-03-30 05:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with identifier: PV97095
2026-03-30 05:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with identifier: PV97095
2026-03-30 05:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee4f8cb9-c597-5b97-b51a-91cae03c2dbe with identifier: PV97095 to the API
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:36:21Z',
 'fuel_type': 'petrol',
 'id': 'ee4f8cb9-c597-5b97-b51a-91cae03c2dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV97095',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 19948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-28',
 'seller_name': None,
 'title': 'Fiat 500X 1.5 Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Saving data for PV97095: {'auction_closing_time': 1774884981.0, 'created_time': 1774637610.931151, 'last_price_update_time': 1774849050.48243}
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV97095') HTTP/1.1" 204 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for KY92219: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for EN93789: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for VC01658: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for BB78660: 0
2026-03-30 05:37:30 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-30 05:37:30 [auto1.de] INFO: Scrape type for TL72332: 0
2026-03-30 05:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:31 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:31 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-30 05:37:31 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-30 05:37:31 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-30 05:37:31 [auto1.de] INFO: Scrape type for PY52590: 2
2026-03-30 05:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afe6f565-e982-5922-99fc-9166ca6bb044 with identifier: PY52590
2026-03-30 05:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afe6f565-e982-5922-99fc-9166ca6bb044 with scrape type 2
2026-03-30 05:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afe6f565-e982-5922-99fc-9166ca6bb044 with scrape type 2
2026-03-30 05:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afe6f565-e982-5922-99fc-9166ca6bb044, identifier: PY52590
2026-03-30 05:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afe6f565-e982-5922-99fc-9166ca6bb044 with identifier: PY52590
2026-03-30 05:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afe6f565-e982-5922-99fc-9166ca6bb044 with identifier: PY52590
2026-03-30 05:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afe6f565-e982-5922-99fc-9166ca6bb044 with identifier: PY52590 to the API
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:32:41Z',
 'fuel_type': 'diesel',
 'id': 'afe6f565-e982-5922-99fc-9166ca6bb044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY52590',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 122876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-05',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-30 05:37:32 [auto1.de] INFO: Saving data for PY52590: {'auction_closing_time': 1774884761.0, 'created_time': 1774638902.181343, 'last_price_update_time': 1774849052.062442}
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY52590') HTTP/1.1" 204 0
2026-03-30 05:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:32 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-30 05:37:32 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-30 05:37:32 [auto1.de] INFO: Scrape type for WC31038: 2
2026-03-30 05:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with identifier: WC31038
2026-03-30 05:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with scrape type 2
2026-03-30 05:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with scrape type 2
2026-03-30 05:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a, identifier: WC31038
2026-03-30 05:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with identifier: WC31038
2026-03-30 05:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with identifier: WC31038
2026-03-30 05:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a with identifier: WC31038 to the API
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:46:07Z',
 'fuel_type': 'diesel',
 'id': '4963ddcf-11aa-5ff3-b0aa-7b86a9f3ec9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC31038',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 117393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-01',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 340 L1 Trail',
 'transmission': 'manual',
 'trim': '340 L1 Trail',
 'year': 2023}
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-30 05:37:32 [auto1.de] INFO: Saving data for WC31038: {'auction_closing_time': 1774885567.0, 'created_time': 1773428353.540771, 'last_price_update_time': 1774849052.583077}
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC31038') HTTP/1.1" 204 0
2026-03-30 05:37:32 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-30 05:37:32 [auto1.de] INFO: Scrape type for HR89143: 2
2026-03-30 05:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with identifier: HR89143
2026-03-30 05:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with scrape type 2
2026-03-30 05:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with scrape type 2
2026-03-30 05:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0876f9c5-88ce-5a4b-a705-b53a39fdb51b, identifier: HR89143
2026-03-30 05:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with identifier: HR89143
2026-03-30 05:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with identifier: HR89143
2026-03-30 05:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0876f9c5-88ce-5a4b-a705-b53a39fdb51b with identifier: HR89143 to the API
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:18:27Z',
 'fuel_type': 'petrol',
 'id': '0876f9c5-88ce-5a4b-a705-b53a39fdb51b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR89143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 81886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up!',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2017}
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Saving data for HR89143: {'auction_closing_time': 1774883907.0, 'created_time': 1773917259.181796, 'last_price_update_time': 1774849053.000065}
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR89143') HTTP/1.1" 204 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for ZN20945: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for DW68578: 2
2026-03-30 05:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-30 05:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0664f5d-d639-5929-b66f-e0e17255f834 with scrape type 2
2026-03-30 05:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0664f5d-d639-5929-b66f-e0e17255f834 with scrape type 2
2026-03-30 05:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0664f5d-d639-5929-b66f-e0e17255f834, identifier: DW68578
2026-03-30 05:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-30 05:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578
2026-03-30 05:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0664f5d-d639-5929-b66f-e0e17255f834 with identifier: DW68578 to the API
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:38Z',
 'fuel_type': 'diesel',
 'id': 'b0664f5d-d639-5929-b66f-e0e17255f834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68578',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 130595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Saving data for DW68578: {'auction_closing_time': 1774886138.0, 'created_time': 1774551857.440397, 'last_price_update_time': 1774849053.54536}
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW68578') HTTP/1.1" 204 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-30 05:37:33 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 05:37:33 [auto1.de] INFO: Scrape type for BD92301: 2
2026-03-30 05:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-30 05:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 653d7bd8-9283-5582-9ee0-ec548f32097e with scrape type 2
2026-03-30 05:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 653d7bd8-9283-5582-9ee0-ec548f32097e with scrape type 2
2026-03-30 05:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 653d7bd8-9283-5582-9ee0-ec548f32097e, identifier: BD92301
2026-03-30 05:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-30 05:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301
2026-03-30 05:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 653d7bd8-9283-5582-9ee0-ec548f32097e with identifier: BD92301 to the API
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:16:13Z',
 'fuel_type': 'petrol',
 'id': '653d7bd8-9283-5582-9ee0-ec548f32097e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD92301',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 160298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-30 05:37:34 [auto1.de] INFO: Saving data for BD92301: {'auction_closing_time': 1774883773.0, 'created_time': 1774551445.545583, 'last_price_update_time': 1774849054.085115}
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD92301') HTTP/1.1" 204 0
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-30 05:37:34 [auto1.de] INFO: Scrape type for TL90122: 2
2026-03-30 05:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1a71330-9ad2-5304-af21-ac2782e8ec5e with identifier: TL90122
2026-03-30 05:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1a71330-9ad2-5304-af21-ac2782e8ec5e with scrape type 2
2026-03-30 05:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1a71330-9ad2-5304-af21-ac2782e8ec5e with scrape type 2
2026-03-30 05:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1a71330-9ad2-5304-af21-ac2782e8ec5e, identifier: TL90122
2026-03-30 05:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1a71330-9ad2-5304-af21-ac2782e8ec5e with identifier: TL90122
2026-03-30 05:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1a71330-9ad2-5304-af21-ac2782e8ec5e with identifier: TL90122
2026-03-30 05:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1a71330-9ad2-5304-af21-ac2782e8ec5e with identifier: TL90122 to the API
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:00Z',
 'fuel_type': 'diesel',
 'id': 'e1a71330-9ad2-5304-af21-ac2782e8ec5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL90122',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 171647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-30 05:37:34 [auto1.de] INFO: Saving data for TL90122: {'auction_closing_time': 1774885440.0, 'created_time': 1774636526.757771, 'last_price_update_time': 1774849054.600864}
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL90122') HTTP/1.1" 204 0
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 05:37:34 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-30 05:37:34 [auto1.de] INFO: Scrape type for ZG14470: 2
2026-03-30 05:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-30 05:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a75274-8b57-59ea-905a-a0c07779c83f with scrape type 2
2026-03-30 05:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a75274-8b57-59ea-905a-a0c07779c83f with scrape type 2
2026-03-30 05:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a75274-8b57-59ea-905a-a0c07779c83f, identifier: ZG14470
2026-03-30 05:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-30 05:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470
2026-03-30 05:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a75274-8b57-59ea-905a-a0c07779c83f with identifier: ZG14470 to the API
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:08Z',
 'fuel_type': 'diesel',
 'id': '25a75274-8b57-59ea-905a-a0c07779c83f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG14470',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 197615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI kompakt Trend',
 'transmission': 'manual',
 'trim': 'kompakt Trend',
 'year': 2006}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Saving data for ZG14470: {'auction_closing_time': 1774884128.0, 'created_time': 1773945209.792634, 'last_price_update_time': 1774849055.025093}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG14470') HTTP/1.1" 204 0
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Scrape type for KZ61437: 2
2026-03-30 05:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-30 05:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3008db6f-3f31-5528-9f7c-6c162deb58c5 with scrape type 2
2026-03-30 05:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3008db6f-3f31-5528-9f7c-6c162deb58c5 with scrape type 2
2026-03-30 05:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3008db6f-3f31-5528-9f7c-6c162deb58c5, identifier: KZ61437
2026-03-30 05:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-30 05:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437
2026-03-30 05:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3008db6f-3f31-5528-9f7c-6c162deb58c5 with identifier: KZ61437 to the API
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:26:34Z',
 'fuel_type': 'diesel',
 'id': '3008db6f-3f31-5528-9f7c-6c162deb58c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ61437',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Aircross',
 'odometer': 114429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Citroen C4 Aircross 1.6 HDi Tendance 2WD',
 'transmission': 'manual',
 'trim': 'Tendance 2WD',
 'year': 2015}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Saving data for KZ61437: {'auction_closing_time': 1774884394.0, 'created_time': 1774552795.143799, 'last_price_update_time': 1774849055.450741}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ61437') HTTP/1.1" 204 0
2026-03-30 05:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Scrape type for WZ19127: 2
2026-03-30 05:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-30 05:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430137e8-c68d-55f2-83d8-0856c986558d with scrape type 2
2026-03-30 05:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 430137e8-c68d-55f2-83d8-0856c986558d with scrape type 2
2026-03-30 05:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 430137e8-c68d-55f2-83d8-0856c986558d, identifier: WZ19127
2026-03-30 05:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-30 05:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127
2026-03-30 05:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 430137e8-c68d-55f2-83d8-0856c986558d with identifier: WZ19127 to the API
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:00:00Z',
 'fuel_type': 'petrol',
 'id': '430137e8-c68d-55f2-83d8-0856c986558d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ19127',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Saving data for WZ19127: {'auction_closing_time': 1774882800.0, 'created_time': 1774551951.341281, 'last_price_update_time': 1774849055.867198}
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ19127') HTTP/1.1" 204 0
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 05:37:35 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 05:37:35 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-30 05:37:35 [auto1.de] INFO: Scrape type for AV62833: 2
2026-03-30 05:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with identifier: AV62833
2026-03-30 05:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with scrape type 2
2026-03-30 05:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with scrape type 2
2026-03-30 05:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da7e9a05-2f45-5349-8f91-5f18b6c9b1ca, identifier: AV62833
2026-03-30 05:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with identifier: AV62833
2026-03-30 05:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with identifier: AV62833
2026-03-30 05:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da7e9a05-2f45-5349-8f91-5f18b6c9b1ca with identifier: AV62833 to the API
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:15:21Z',
 'fuel_type': 'petrol',
 'id': 'da7e9a05-2f45-5349-8f91-5f18b6c9b1ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV62833',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 77804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2019}
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-30 05:37:36 [auto1.de] INFO: Saving data for AV62833: {'auction_closing_time': 1774883721.0, 'created_time': 1774639263.535376, 'last_price_update_time': 1774849056.297798}
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV62833') HTTP/1.1" 204 0
2026-03-30 05:37:36 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-30 05:37:36 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-30 05:37:36 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-30 05:37:36 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-30 05:37:36 [auto1.de] INFO: Scrape type for KL19137: 2
2026-03-30 05:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-30 05:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ec871b-e4ae-5785-b497-d4c3f98c44fa with scrape type 2
2026-03-30 05:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ec871b-e4ae-5785-b497-d4c3f98c44fa with scrape type 2
2026-03-30 05:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5ec871b-e4ae-5785-b497-d4c3f98c44fa, identifier: KL19137
2026-03-30 05:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-30 05:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137
2026-03-30 05:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5ec871b-e4ae-5785-b497-d4c3f98c44fa with identifier: KL19137 to the API
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'hybrid',
 'id': 'c5ec871b-e4ae-5785-b497-d4c3f98c44fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL19137',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 124879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Audi Q5 55 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-30 05:37:36 [auto1.de] INFO: Saving data for KL19137: {'auction_closing_time': 1774884180.0, 'created_time': 1774552593.305863, 'last_price_update_time': 1774849056.808859}
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL19137') HTTP/1.1" 204 0
2026-03-30 05:37:36 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-30 05:37:36 [auto1.de] INFO: Scrape type for PA63751: 2
2026-03-30 05:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f70bd87-732c-5f27-9923-551bac0f0db7 with identifier: PA63751
2026-03-30 05:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f70bd87-732c-5f27-9923-551bac0f0db7 with scrape type 2
2026-03-30 05:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f70bd87-732c-5f27-9923-551bac0f0db7 with scrape type 2
2026-03-30 05:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f70bd87-732c-5f27-9923-551bac0f0db7, identifier: PA63751
2026-03-30 05:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f70bd87-732c-5f27-9923-551bac0f0db7 with identifier: PA63751
2026-03-30 05:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f70bd87-732c-5f27-9923-551bac0f0db7 with identifier: PA63751
2026-03-30 05:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f70bd87-732c-5f27-9923-551bac0f0db7 with identifier: PA63751 to the API
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:16:41Z',
 'fuel_type': 'electro',
 'id': '4f70bd87-732c-5f27-9923-551bac0f0db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA63751',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'EQV',
 'odometer': 21929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seller_name': None,
 'title': 'Mercedes-Benz EQV 300 lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2021}
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-30 05:37:37 [auto1.de] INFO: Saving data for PA63751: {'auction_closing_time': 1774883801.0, 'created_time': 1774637024.941337, 'last_price_update_time': 1774849057.214142}
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA63751') HTTP/1.1" 204 0
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-30 05:37:37 [auto1.de] INFO: Scrape type for LC63229: 2
2026-03-30 05:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8649b24-392f-530f-8b1c-4ed71619ad23 with identifier: LC63229
2026-03-30 05:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8649b24-392f-530f-8b1c-4ed71619ad23 with scrape type 2
2026-03-30 05:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8649b24-392f-530f-8b1c-4ed71619ad23 with scrape type 2
2026-03-30 05:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8649b24-392f-530f-8b1c-4ed71619ad23, identifier: LC63229
2026-03-30 05:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8649b24-392f-530f-8b1c-4ed71619ad23 with identifier: LC63229
2026-03-30 05:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8649b24-392f-530f-8b1c-4ed71619ad23 with identifier: LC63229
2026-03-30 05:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8649b24-392f-530f-8b1c-4ed71619ad23 with identifier: LC63229 to the API
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:52:03Z',
 'fuel_type': 'petrol',
 'id': 'e8649b24-392f-530f-8b1c-4ed71619ad23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC63229',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 121023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Go Plus',
 'transmission': 'manual',
 'trim': 'Go Plus',
 'year': 2017}
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-30 05:37:37 [auto1.de] INFO: Saving data for LC63229: {'auction_closing_time': 1774885923.0, 'created_time': 1773342378.155474, 'last_price_update_time': 1774849057.605216}
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC63229') HTTP/1.1" 204 0
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-30 05:37:37 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-30 05:37:37 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-30 05:37:37 [auto1.de] INFO: Scrape type for SN72199: 2
2026-03-30 05:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c5090f-c9a5-57c8-b41e-c40898734dc6 with identifier: SN72199
2026-03-30 05:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c5090f-c9a5-57c8-b41e-c40898734dc6 with scrape type 2
2026-03-30 05:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70c5090f-c9a5-57c8-b41e-c40898734dc6 with scrape type 2
2026-03-30 05:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70c5090f-c9a5-57c8-b41e-c40898734dc6, identifier: SN72199
2026-03-30 05:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70c5090f-c9a5-57c8-b41e-c40898734dc6 with identifier: SN72199
2026-03-30 05:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70c5090f-c9a5-57c8-b41e-c40898734dc6 with identifier: SN72199
2026-03-30 05:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70c5090f-c9a5-57c8-b41e-c40898734dc6 with identifier: SN72199 to the API
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:05Z',
 'fuel_type': 'petrol',
 'id': '70c5090f-c9a5-57c8-b41e-c40898734dc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN72199',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 167387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Saving data for SN72199: {'auction_closing_time': 1774886285.0, 'created_time': 1773302886.340232, 'last_price_update_time': 1774849058.068091}
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN72199') HTTP/1.1" 204 0
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Scrape type for MX17219: 2
2026-03-30 05:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e805023-e926-5521-b023-ee404dcabdde with identifier: MX17219
2026-03-30 05:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e805023-e926-5521-b023-ee404dcabdde with scrape type 2
2026-03-30 05:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e805023-e926-5521-b023-ee404dcabdde with scrape type 2
2026-03-30 05:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e805023-e926-5521-b023-ee404dcabdde, identifier: MX17219
2026-03-30 05:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e805023-e926-5521-b023-ee404dcabdde with identifier: MX17219
2026-03-30 05:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e805023-e926-5521-b023-ee404dcabdde with identifier: MX17219
2026-03-30 05:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e805023-e926-5521-b023-ee404dcabdde with identifier: MX17219 to the API
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'diesel',
 'id': '6e805023-e926-5521-b023-ee404dcabdde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX17219',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 217810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-30',
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Saving data for MX17219: {'auction_closing_time': 1774883487.0, 'created_time': 1774638350.431171, 'last_price_update_time': 1774849058.59906}
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX17219') HTTP/1.1" 204 0
2026-03-30 05:37:38 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-30 05:37:38 [auto1.de] INFO: Scrape type for EJ74150: 2
2026-03-30 05:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2089eaf-b676-5da3-931c-5cae7b349952 with identifier: EJ74150
2026-03-30 05:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2089eaf-b676-5da3-931c-5cae7b349952 with scrape type 2
2026-03-30 05:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2089eaf-b676-5da3-931c-5cae7b349952 with scrape type 2
2026-03-30 05:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2089eaf-b676-5da3-931c-5cae7b349952, identifier: EJ74150
2026-03-30 05:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2089eaf-b676-5da3-931c-5cae7b349952 with identifier: EJ74150
2026-03-30 05:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2089eaf-b676-5da3-931c-5cae7b349952 with identifier: EJ74150
2026-03-30 05:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2089eaf-b676-5da3-931c-5cae7b349952 with identifier: EJ74150 to the API
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': 'a2089eaf-b676-5da3-931c-5cae7b349952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ74150',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 144217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2016}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Saving data for EJ74150: {'auction_closing_time': 1774885441.0, 'created_time': 1774549855.854528, 'last_price_update_time': 1774849059.012034}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ74150') HTTP/1.1" 204 0
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Scrape type for FF11378: 2
2026-03-30 05:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27857e2-127d-56aa-999a-7bf98f6b0bdc with identifier: FF11378
2026-03-30 05:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27857e2-127d-56aa-999a-7bf98f6b0bdc with scrape type 2
2026-03-30 05:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e27857e2-127d-56aa-999a-7bf98f6b0bdc with scrape type 2
2026-03-30 05:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e27857e2-127d-56aa-999a-7bf98f6b0bdc, identifier: FF11378
2026-03-30 05:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e27857e2-127d-56aa-999a-7bf98f6b0bdc with identifier: FF11378
2026-03-30 05:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e27857e2-127d-56aa-999a-7bf98f6b0bdc with identifier: FF11378
2026-03-30 05:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e27857e2-127d-56aa-999a-7bf98f6b0bdc with identifier: FF11378 to the API
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:12:12Z',
 'fuel_type': 'diesel',
 'id': 'e27857e2-127d-56aa-999a-7bf98f6b0bdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF11378',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 106358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-16',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Trend',
 'transmission': 'automatic',
 'trim': 'Travel Trend',
 'year': 2017}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Saving data for FF11378: {'auction_closing_time': 1774883532.0, 'created_time': 1774636540.709822, 'last_price_update_time': 1774849059.434391}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF11378') HTTP/1.1" 204 0
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Scrape type for HZ32658: 2
2026-03-30 05:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d905b8-82af-5df9-b2df-3a957785f768 with identifier: HZ32658
2026-03-30 05:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d905b8-82af-5df9-b2df-3a957785f768 with scrape type 2
2026-03-30 05:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2d905b8-82af-5df9-b2df-3a957785f768 with scrape type 2
2026-03-30 05:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2d905b8-82af-5df9-b2df-3a957785f768, identifier: HZ32658
2026-03-30 05:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2d905b8-82af-5df9-b2df-3a957785f768 with identifier: HZ32658
2026-03-30 05:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2d905b8-82af-5df9-b2df-3a957785f768 with identifier: HZ32658
2026-03-30 05:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2d905b8-82af-5df9-b2df-3a957785f768 with identifier: HZ32658 to the API
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:23Z',
 'fuel_type': 'diesel',
 'id': 'c2d905b8-82af-5df9-b2df-3a957785f768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ32658',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 283321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-20',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Saving data for HZ32658: {'auction_closing_time': 1774883243.0, 'created_time': 1774031486.961532, 'last_price_update_time': 1774849059.960692}
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ32658') HTTP/1.1" 204 0
2026-03-30 05:37:39 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-30 05:37:39 [auto1.de] INFO: Scrape type for KD58874: 2
2026-03-30 05:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with identifier: KD58874
2026-03-30 05:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with scrape type 2
2026-03-30 05:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with scrape type 2
2026-03-30 05:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6, identifier: KD58874
2026-03-30 05:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with identifier: KD58874
2026-03-30 05:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with identifier: KD58874
2026-03-30 05:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6 with identifier: KD58874 to the API
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:00:58Z',
 'fuel_type': 'hybrid',
 'id': 'ac3c9e44-3a58-59dd-9ad7-5b0e1229a8e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD58874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 42141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-30 05:37:40 [auto1.de] INFO: Saving data for KD58874: {'auction_closing_time': 1774882858.0, 'created_time': 1773428374.558175, 'last_price_update_time': 1774849060.40223}
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD58874') HTTP/1.1" 204 0
2026-03-30 05:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:40 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-30 05:37:40 [auto1.de] INFO: Scrape type for SN47860: 2
2026-03-30 05:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65aba651-296d-5750-86e5-f2106a459f28 with identifier: SN47860
2026-03-30 05:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65aba651-296d-5750-86e5-f2106a459f28 with scrape type 2
2026-03-30 05:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65aba651-296d-5750-86e5-f2106a459f28 with scrape type 2
2026-03-30 05:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65aba651-296d-5750-86e5-f2106a459f28, identifier: SN47860
2026-03-30 05:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65aba651-296d-5750-86e5-f2106a459f28 with identifier: SN47860
2026-03-30 05:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65aba651-296d-5750-86e5-f2106a459f28 with identifier: SN47860
2026-03-30 05:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65aba651-296d-5750-86e5-f2106a459f28 with identifier: SN47860 to the API
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-30T15:00:51Z',
 'fuel_type': 'petrol',
 'id': '65aba651-296d-5750-86e5-f2106a459f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN47860',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 227687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TSI GTI Edition 35',
 'transmission': 'manual',
 'trim': 'GTI Edition 35',
 'year': 2013}
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-30 05:37:40 [auto1.de] INFO: Saving data for SN47860: {'auction_closing_time': 1774882851.0, 'created_time': 1773945091.492312, 'last_price_update_time': 1774849060.842816}
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN47860') HTTP/1.1" 204 0
2026-03-30 05:37:40 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-30 05:37:40 [auto1.de] INFO: Scrape type for SG53147: 2
2026-03-30 05:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3758c85-731f-5120-ba52-305a560642e0 with identifier: SG53147
2026-03-30 05:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3758c85-731f-5120-ba52-305a560642e0 with scrape type 2
2026-03-30 05:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3758c85-731f-5120-ba52-305a560642e0 with scrape type 2
2026-03-30 05:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3758c85-731f-5120-ba52-305a560642e0, identifier: SG53147
2026-03-30 05:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3758c85-731f-5120-ba52-305a560642e0 with identifier: SG53147
2026-03-30 05:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3758c85-731f-5120-ba52-305a560642e0 with identifier: SG53147
2026-03-30 05:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3758c85-731f-5120-ba52-305a560642e0 with identifier: SG53147 to the API
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'diesel',
 'id': 'a3758c85-731f-5120-ba52-305a560642e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG53147',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 118079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-07',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '320 L1 Tourneo Titanium',
 'year': 2020}
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Saving data for SG53147: {'auction_closing_time': 1774884048.0, 'created_time': 1773466921.135915, 'last_price_update_time': 1774849061.267832}
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG53147') HTTP/1.1" 204 0
2026-03-30 05:37:41 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Scrape type for WF56073: 0
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Scrape type for NG52240: 2
2026-03-30 05:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c29362c2-d23b-5ffe-a35d-d9ca0e93081c with identifier: NG52240
2026-03-30 05:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c29362c2-d23b-5ffe-a35d-d9ca0e93081c with scrape type 2
2026-03-30 05:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c29362c2-d23b-5ffe-a35d-d9ca0e93081c with scrape type 2
2026-03-30 05:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c29362c2-d23b-5ffe-a35d-d9ca0e93081c, identifier: NG52240
2026-03-30 05:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c29362c2-d23b-5ffe-a35d-d9ca0e93081c with identifier: NG52240
2026-03-30 05:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c29362c2-d23b-5ffe-a35d-d9ca0e93081c with identifier: NG52240
2026-03-30 05:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c29362c2-d23b-5ffe-a35d-d9ca0e93081c with identifier: NG52240 to the API
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:57Z',
 'fuel_type': 'diesel',
 'id': 'c29362c2-d23b-5ffe-a35d-d9ca0e93081c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG52240',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 132902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Saving data for NG52240: {'auction_closing_time': 1774883457.0, 'created_time': 1774638580.71586, 'last_price_update_time': 1774849061.698834}
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG52240') HTTP/1.1" 204 0
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-30 05:37:41 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-30 05:37:41 [auto1.de] INFO: Scrape type for VW19119: 2
2026-03-30 05:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 972a5044-f92f-5ba8-b830-97bface31b40 with identifier: VW19119
2026-03-30 05:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 972a5044-f92f-5ba8-b830-97bface31b40 with scrape type 2
2026-03-30 05:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 972a5044-f92f-5ba8-b830-97bface31b40 with scrape type 2
2026-03-30 05:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 972a5044-f92f-5ba8-b830-97bface31b40, identifier: VW19119
2026-03-30 05:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 972a5044-f92f-5ba8-b830-97bface31b40 with identifier: VW19119
2026-03-30 05:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 972a5044-f92f-5ba8-b830-97bface31b40 with identifier: VW19119
2026-03-30 05:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 972a5044-f92f-5ba8-b830-97bface31b40 with identifier: VW19119 to the API
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:10:14Z',
 'fuel_type': 'petrol',
 'id': '972a5044-f92f-5ba8-b830-97bface31b40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW19119',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 162566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'BMW 5er 550i GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Saving data for VW19119: {'auction_closing_time': 1774883414.0, 'created_time': 1774435804.479761, 'last_price_update_time': 1774849062.10015}
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW19119') HTTP/1.1" 204 0
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Scrape type for YB86869: 2
2026-03-30 05:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with identifier: YB86869
2026-03-30 05:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with scrape type 2
2026-03-30 05:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with scrape type 2
2026-03-30 05:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71, identifier: YB86869
2026-03-30 05:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with identifier: YB86869
2026-03-30 05:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with identifier: YB86869
2026-03-30 05:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71 with identifier: YB86869 to the API
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'petrol',
 'id': 'e5a33f95-3d0a-56a6-8d6f-cfbc9bc44e71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB86869',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 110221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2018}
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Saving data for YB86869: {'auction_closing_time': 1774884503.0, 'created_time': 1772541637.94157, 'last_price_update_time': 1774849062.633977}
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB86869') HTTP/1.1" 204 0
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Scrape type for TP00598: 0
2026-03-30 05:37:42 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-30 05:37:42 [auto1.de] INFO: Scrape type for LD63476: 2
2026-03-30 05:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc9511f-f02b-542d-a3e5-1a79a298b718 with identifier: LD63476
2026-03-30 05:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc9511f-f02b-542d-a3e5-1a79a298b718 with scrape type 2
2026-03-30 05:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cc9511f-f02b-542d-a3e5-1a79a298b718 with scrape type 2
2026-03-30 05:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cc9511f-f02b-542d-a3e5-1a79a298b718, identifier: LD63476
2026-03-30 05:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cc9511f-f02b-542d-a3e5-1a79a298b718 with identifier: LD63476
2026-03-30 05:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cc9511f-f02b-542d-a3e5-1a79a298b718 with identifier: LD63476
2026-03-30 05:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cc9511f-f02b-542d-a3e5-1a79a298b718 with identifier: LD63476 to the API
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:49:52Z',
 'fuel_type': 'petrol',
 'id': '0cc9511f-f02b-542d-a3e5-1a79a298b718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD63476',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 131514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club BlueMotion Tech',
 'year': 2015}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Saving data for LD63476: {'auction_closing_time': 1774885792.0, 'created_time': 1774636500.436436, 'last_price_update_time': 1774849063.10127}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD63476') HTTP/1.1" 204 0
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Scrape type for XB50161: 2
2026-03-30 05:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-30 05:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71ac3805-0b62-5141-8886-cf835a0c86d5 with scrape type 2
2026-03-30 05:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71ac3805-0b62-5141-8886-cf835a0c86d5 with scrape type 2
2026-03-30 05:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71ac3805-0b62-5141-8886-cf835a0c86d5, identifier: XB50161
2026-03-30 05:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-30 05:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161
2026-03-30 05:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71ac3805-0b62-5141-8886-cf835a0c86d5 with identifier: XB50161 to the API
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:46:34Z',
 'fuel_type': 'diesel',
 'id': '71ac3805-0b62-5141-8886-cf835a0c86d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB50161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 96576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 116 CDI lang 4Matic Select',
 'transmission': 'automatic',
 'trim': 'lang 4Matic Select',
 'year': 2017}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Saving data for XB50161: {'auction_closing_time': 1774885594.0, 'created_time': 1774550506.757029, 'last_price_update_time': 1774849063.498661}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB50161') HTTP/1.1" 204 0
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Scrape type for HL19525: 2
2026-03-30 05:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with identifier: HL19525
2026-03-30 05:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with scrape type 2
2026-03-30 05:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with scrape type 2
2026-03-30 05:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3, identifier: HL19525
2026-03-30 05:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with identifier: HL19525
2026-03-30 05:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with identifier: HL19525
2026-03-30 05:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c7fe4c-0fa3-5985-9c27-9177b3d8bca3 with identifier: HL19525 to the API
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:13Z',
 'fuel_type': 'petrol',
 'id': '63c7fe4c-0fa3-5985-9c27-9177b3d8bca3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL19525',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 20068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-05',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2017}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Saving data for HL19525: {'auction_closing_time': 1774884433.0, 'created_time': 1774637418.924757, 'last_price_update_time': 1774849063.942755}
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL19525') HTTP/1.1" 204 0
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Scrape type for WY73016: 0
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-30 05:37:43 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-30 05:37:43 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-30 05:37:44 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-30 05:37:44 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-30 05:37:44 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-30 05:37:44 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-30 05:37:44 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-30 05:37:44 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-30 05:37:44 [auto1.de] INFO: Scrape type for MD44435: 2
2026-03-30 05:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 093346dc-cc3f-56e6-882c-51e08ad3ff18 with identifier: MD44435
2026-03-30 05:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 093346dc-cc3f-56e6-882c-51e08ad3ff18 with scrape type 2
2026-03-30 05:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 093346dc-cc3f-56e6-882c-51e08ad3ff18 with scrape type 2
2026-03-30 05:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 093346dc-cc3f-56e6-882c-51e08ad3ff18, identifier: MD44435
2026-03-30 05:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 093346dc-cc3f-56e6-882c-51e08ad3ff18 with identifier: MD44435
2026-03-30 05:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 093346dc-cc3f-56e6-882c-51e08ad3ff18 with identifier: MD44435
2026-03-30 05:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 093346dc-cc3f-56e6-882c-51e08ad3ff18 with identifier: MD44435 to the API
2026-03-30 05:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'diesel',
 'id': '093346dc-cc3f-56e6-882c-51e08ad3ff18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD44435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLC-Klasse',
 'odometer': 272711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLC-Klasse CLC 220 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-30 05:37:45 [auto1.de] INFO: Saving data for MD44435: {'auction_closing_time': 1774885690.0, 'created_time': 1774638104.923105, 'last_price_update_time': 1774849065.254781}
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD44435') HTTP/1.1" 204 0
2026-03-30 05:37:45 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-30 05:37:45 [auto1.de] INFO: Scrape type for FJ78766: 2
2026-03-30 05:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with identifier: FJ78766
2026-03-30 05:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with scrape type 2
2026-03-30 05:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with scrape type 2
2026-03-30 05:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8375f4fd-5a6b-5d02-b72c-6456b1d76ada, identifier: FJ78766
2026-03-30 05:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with identifier: FJ78766
2026-03-30 05:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with identifier: FJ78766
2026-03-30 05:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8375f4fd-5a6b-5d02-b72c-6456b1d76ada with identifier: FJ78766 to the API
2026-03-30 05:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:10Z',
 'fuel_type': 'diesel',
 'id': '8375f4fd-5a6b-5d02-b72c-6456b1d76ada',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ78766',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 192672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-30 05:37:46 [auto1.de] INFO: Saving data for FJ78766: {'auction_closing_time': 1774884850.0, 'created_time': 1773917119.464267, 'last_price_update_time': 1774849066.252796}
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ78766') HTTP/1.1" 204 0
2026-03-30 05:37:46 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-30 05:37:46 [auto1.de] INFO: Scrape type for AE64290: 2
2026-03-30 05:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b4f9474-3870-5717-9acb-d692292733e5 with identifier: AE64290
2026-03-30 05:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b4f9474-3870-5717-9acb-d692292733e5 with scrape type 2
2026-03-30 05:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b4f9474-3870-5717-9acb-d692292733e5 with scrape type 2
2026-03-30 05:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b4f9474-3870-5717-9acb-d692292733e5, identifier: AE64290
2026-03-30 05:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b4f9474-3870-5717-9acb-d692292733e5 with identifier: AE64290
2026-03-30 05:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b4f9474-3870-5717-9acb-d692292733e5 with identifier: AE64290
2026-03-30 05:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b4f9474-3870-5717-9acb-d692292733e5 with identifier: AE64290 to the API
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:01:41Z',
 'fuel_type': 'petrol',
 'id': '6b4f9474-3870-5717-9acb-d692292733e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE64290',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 47394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-20',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-30 05:37:46 [auto1.de] INFO: Saving data for AE64290: {'auction_closing_time': 1774882901.0, 'created_time': 1774521887.851589, 'last_price_update_time': 1774849066.667945}
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE64290') HTTP/1.1" 204 0
2026-03-30 05:37:46 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 05:37:46 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-30 05:37:46 [auto1.de] INFO: Scrape type for BS22515: 2
2026-03-30 05:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b54c65-670d-5a39-9f02-568767cb6ce5 with identifier: BS22515
2026-03-30 05:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b54c65-670d-5a39-9f02-568767cb6ce5 with scrape type 2
2026-03-30 05:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b54c65-670d-5a39-9f02-568767cb6ce5 with scrape type 2
2026-03-30 05:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72b54c65-670d-5a39-9f02-568767cb6ce5, identifier: BS22515
2026-03-30 05:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72b54c65-670d-5a39-9f02-568767cb6ce5 with identifier: BS22515
2026-03-30 05:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72b54c65-670d-5a39-9f02-568767cb6ce5 with identifier: BS22515
2026-03-30 05:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72b54c65-670d-5a39-9f02-568767cb6ce5 with identifier: BS22515 to the API
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 162,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '72b54c65-670d-5a39-9f02-568767cb6ce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS22515',
 'listing': 'auction',
 'make': 'MG',
 'model': 'HS',
 'odometer': 22546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-24',
 'seller_name': None,
 'title': 'MG HS 1.5 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2024}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Saving data for BS22515: {'auction_closing_time': 1774886055.0, 'created_time': 1774639165.771853, 'last_price_update_time': 1774849067.085687}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS22515') HTTP/1.1" 204 0
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Scrape type for GK43362: 0
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Scrape type for NL88078: 2
2026-03-30 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with identifier: NL88078
2026-03-30 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with scrape type 2
2026-03-30 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with scrape type 2
2026-03-30 05:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1, identifier: NL88078
2026-03-30 05:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with identifier: NL88078
2026-03-30 05:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with identifier: NL88078
2026-03-30 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 038f3e58-e9ee-5d2b-aaef-6bef722b5eb1 with identifier: NL88078 to the API
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'petrol',
 'id': '038f3e58-e9ee-5d2b-aaef-6bef722b5eb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL88078',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 101625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Platinum Edition",
 'transmission': 'automatic',
 'trim': 'Platinum Edition',
 'year': 2016}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Saving data for NL88078: {'auction_closing_time': 1774883847.0, 'created_time': 1773830693.198043, 'last_price_update_time': 1774849067.504605}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL88078') HTTP/1.1" 204 0
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Scrape type for WS02487: 2
2026-03-30 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-30 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ebf2e54-c571-56db-afed-9b73305e8042 with scrape type 2
2026-03-30 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ebf2e54-c571-56db-afed-9b73305e8042 with scrape type 2
2026-03-30 05:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ebf2e54-c571-56db-afed-9b73305e8042, identifier: WS02487
2026-03-30 05:37:47 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-30 05:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487
2026-03-30 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ebf2e54-c571-56db-afed-9b73305e8042 with identifier: WS02487 to the API
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:14:53Z',
 'fuel_type': 'petrol',
 'id': '2ebf2e54-c571-56db-afed-9b73305e8042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS02487',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 80912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-04',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Saving data for WS02487: {'auction_closing_time': 1774883693.0, 'created_time': 1774552594.082161, 'last_price_update_time': 1774849067.914611}
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS02487') HTTP/1.1" 204 0
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-30 05:37:47 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-30 05:37:47 [auto1.de] INFO: Scrape type for EZ85797: 2
2026-03-30 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with identifier: EZ85797
2026-03-30 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with scrape type 2
2026-03-30 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with scrape type 2
2026-03-30 05:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74, identifier: EZ85797
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Scrape type for BX05285: 2
2026-03-30 05:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1096ce74-42fe-5041-a262-f6237367bbd2 with identifier: BX05285
2026-03-30 05:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1096ce74-42fe-5041-a262-f6237367bbd2 with scrape type 2
2026-03-30 05:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1096ce74-42fe-5041-a262-f6237367bbd2 with scrape type 2
2026-03-30 05:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1096ce74-42fe-5041-a262-f6237367bbd2, identifier: BX05285
2026-03-30 05:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with identifier: EZ85797
2026-03-30 05:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with identifier: EZ85797
2026-03-30 05:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74 with identifier: EZ85797 to the API
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:14Z',
 'fuel_type': 'petrol',
 'id': '3cd7070f-ebd6-5a70-9b37-0e7dd1cb8e74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ85797',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 111892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-20',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Saving data for EZ85797: {'auction_closing_time': 1774885334.0, 'created_time': 1774638553.204533, 'last_price_update_time': 1774849068.491558}
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ85797') HTTP/1.1" 204 0
2026-03-30 05:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1096ce74-42fe-5041-a262-f6237367bbd2 with identifier: BX05285
2026-03-30 05:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1096ce74-42fe-5041-a262-f6237367bbd2 with identifier: BX05285
2026-03-30 05:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1096ce74-42fe-5041-a262-f6237367bbd2 with identifier: BX05285 to the API
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:57:01Z',
 'fuel_type': 'diesel',
 'id': '1096ce74-42fe-5041-a262-f6237367bbd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX05285',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 144732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-22',
 'seller_name': None,
 'title': 'Ford Transit 1.8 TDCi Kasten Lang',
 'transmission': 'manual',
 'trim': 'Kasten Lang',
 'year': 2011}
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Saving data for BX05285: {'auction_closing_time': 1774886221.0, 'created_time': 1774551195.106932, 'last_price_update_time': 1774849068.869622}
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX05285') HTTP/1.1" 204 0
2026-03-30 05:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-30 05:37:48 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-30 05:37:48 [auto1.de] INFO: Scrape type for CW19006: 2
2026-03-30 05:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-30 05:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae805118-25e4-512e-8425-dfd58de8f565 with scrape type 2
2026-03-30 05:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae805118-25e4-512e-8425-dfd58de8f565 with scrape type 2
2026-03-30 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae805118-25e4-512e-8425-dfd58de8f565, identifier: CW19006
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for KD34962: 2
2026-03-30 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222db02e-2634-529a-9999-ee54c990c3ac with identifier: KD34962
2026-03-30 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222db02e-2634-529a-9999-ee54c990c3ac with scrape type 2
2026-03-30 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222db02e-2634-529a-9999-ee54c990c3ac with scrape type 2
2026-03-30 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 222db02e-2634-529a-9999-ee54c990c3ac, identifier: KD34962
2026-03-30 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-30 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006
2026-03-30 05:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae805118-25e4-512e-8425-dfd58de8f565 with identifier: CW19006 to the API
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'diesel',
 'id': 'ae805118-25e4-512e-8425-dfd58de8f565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW19006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 151693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-16',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Saving data for CW19006: {'auction_closing_time': 1774884653.0, 'created_time': 1774552129.520538, 'last_price_update_time': 1774849069.518077}
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW19006') HTTP/1.1" 204 0
2026-03-30 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 222db02e-2634-529a-9999-ee54c990c3ac with identifier: KD34962
2026-03-30 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 222db02e-2634-529a-9999-ee54c990c3ac with identifier: KD34962
2026-03-30 05:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 222db02e-2634-529a-9999-ee54c990c3ac with identifier: KD34962 to the API
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:57Z',
 'fuel_type': 'petrol',
 'id': '222db02e-2634-529a-9999-ee54c990c3ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD34962',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 133989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Saving data for KD34962: {'auction_closing_time': 1774883817.0, 'created_time': 1773428465.160566, 'last_price_update_time': 1774849069.920821}
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD34962') HTTP/1.1" 204 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 05:37:49 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-30 05:37:49 [auto1.de] INFO: Scrape type for ES44709: 2
2026-03-30 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-30 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf1284d-20cc-595c-9384-9b4d4d4d30a5 with scrape type 2
2026-03-30 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf1284d-20cc-595c-9384-9b4d4d4d30a5 with scrape type 2
2026-03-30 05:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acf1284d-20cc-595c-9384-9b4d4d4d30a5, identifier: ES44709
2026-03-30 05:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-30 05:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709
2026-03-30 05:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acf1284d-20cc-595c-9384-9b4d4d4d30a5 with identifier: ES44709 to the API
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:14:58Z',
 'fuel_type': 'petrol',
 'id': 'acf1284d-20cc-595c-9384-9b4d4d4d30a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES44709',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 19149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-07',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Nightline Edition",
 'transmission': 'manual',
 'trim': 'Nightline Edition',
 'year': 2024}
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Saving data for ES44709: {'auction_closing_time': 1774883698.0, 'created_time': 1774551494.759644, 'last_price_update_time': 1774849070.360216}
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES44709') HTTP/1.1" 204 0
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Scrape type for GM59339: 2
2026-03-30 05:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-30 05:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2245e0c8-3e64-53b3-8088-060e684973b8 with scrape type 2
2026-03-30 05:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2245e0c8-3e64-53b3-8088-060e684973b8 with scrape type 2
2026-03-30 05:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2245e0c8-3e64-53b3-8088-060e684973b8, identifier: GM59339
2026-03-30 05:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-30 05:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339
2026-03-30 05:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2245e0c8-3e64-53b3-8088-060e684973b8 with identifier: GM59339 to the API
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:12:54Z',
 'fuel_type': 'diesel',
 'id': '2245e0c8-3e64-53b3-8088-060e684973b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 147134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-02',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Saving data for GM59339: {'auction_closing_time': 1774883574.0, 'created_time': 1774553021.213282, 'last_price_update_time': 1774849070.768821}
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM59339') HTTP/1.1" 204 0
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Scrape type for VS72441: 0
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-30 05:37:50 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-30 05:37:50 [auto1.de] INFO: Scrape type for JE81559: 2
2026-03-30 05:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e209a8a8-1212-536a-b6d1-b3664a133844 with identifier: JE81559
2026-03-30 05:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e209a8a8-1212-536a-b6d1-b3664a133844 with scrape type 2
2026-03-30 05:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e209a8a8-1212-536a-b6d1-b3664a133844 with scrape type 2
2026-03-30 05:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e209a8a8-1212-536a-b6d1-b3664a133844, identifier: JE81559
2026-03-30 05:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e209a8a8-1212-536a-b6d1-b3664a133844 with identifier: JE81559
2026-03-30 05:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e209a8a8-1212-536a-b6d1-b3664a133844 with identifier: JE81559
2026-03-30 05:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e209a8a8-1212-536a-b6d1-b3664a133844 with identifier: JE81559 to the API
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:02:00Z',
 'fuel_type': 'petrol',
 'id': 'e209a8a8-1212-536a-b6d1-b3664a133844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE81559',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 60787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2018}
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-30 05:37:51 [auto1.de] INFO: Saving data for JE81559: {'auction_closing_time': 1774882920.0, 'created_time': 1773228074.854617, 'last_price_update_time': 1774849071.253054}
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE81559') HTTP/1.1" 204 0
2026-03-30 05:37:51 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-30 05:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:52 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:52 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-30 05:37:52 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-30 05:37:52 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-30 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-30 05:37:52 [auto1.de] INFO: Scrape type for AM19734: 0
2026-03-30 05:37:52 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-30 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-30 05:37:52 [auto1.de] INFO: Scrape type for HU29731: 2
2026-03-30 05:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with identifier: HU29731
2026-03-30 05:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with scrape type 2
2026-03-30 05:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with scrape type 2
2026-03-30 05:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cea6424-d7ef-59b6-9b76-6e39fc28fab3, identifier: HU29731
2026-03-30 05:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with identifier: HU29731
2026-03-30 05:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with identifier: HU29731
2026-03-30 05:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cea6424-d7ef-59b6-9b76-6e39fc28fab3 with identifier: HU29731 to the API
2026-03-30 05:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:37:10Z',
 'fuel_type': 'petrol',
 'id': '5cea6424-d7ef-59b6-9b76-6e39fc28fab3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU29731',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'Q30',
 'odometer': 62125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-17',
 'seller_name': None,
 'title': 'Infiniti Q30 2.0 Turbo Sport Tech AWD',
 'transmission': 'automatic',
 'trim': 'Sport Tech AWD',
 'year': 2020}
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Saving data for HU29731: {'auction_closing_time': 1774885030.0, 'created_time': 1773427014.231674, 'last_price_update_time': 1774849073.177291}
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU29731') HTTP/1.1" 204 0
2026-03-30 05:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Scrape type for UZ52700: 2
2026-03-30 05:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0439ea89-0040-5cd4-9312-c39f0f3ad151 with identifier: UZ52700
2026-03-30 05:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0439ea89-0040-5cd4-9312-c39f0f3ad151 with scrape type 2
2026-03-30 05:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0439ea89-0040-5cd4-9312-c39f0f3ad151 with scrape type 2
2026-03-30 05:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0439ea89-0040-5cd4-9312-c39f0f3ad151, identifier: UZ52700
2026-03-30 05:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0439ea89-0040-5cd4-9312-c39f0f3ad151 with identifier: UZ52700
2026-03-30 05:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0439ea89-0040-5cd4-9312-c39f0f3ad151 with identifier: UZ52700
2026-03-30 05:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0439ea89-0040-5cd4-9312-c39f0f3ad151 with identifier: UZ52700 to the API
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:39:20Z',
 'fuel_type': 'petrol',
 'id': '0439ea89-0040-5cd4-9312-c39f0f3ad151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ52700',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 21214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2024}
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Saving data for UZ52700: {'auction_closing_time': 1774885160.0, 'created_time': 1773343959.845603, 'last_price_update_time': 1774849073.597886}
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ52700') HTTP/1.1" 204 0
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Scrape type for MA76308: 0
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-30 05:37:53 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-30 05:37:53 [auto1.de] INFO: Scrape type for PS82659: 2
2026-03-30 05:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651ed06a-e97c-5b46-a0df-f92c57f58635 with identifier: PS82659
2026-03-30 05:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651ed06a-e97c-5b46-a0df-f92c57f58635 with scrape type 2
2026-03-30 05:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651ed06a-e97c-5b46-a0df-f92c57f58635 with scrape type 2
2026-03-30 05:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651ed06a-e97c-5b46-a0df-f92c57f58635, identifier: PS82659
2026-03-30 05:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651ed06a-e97c-5b46-a0df-f92c57f58635 with identifier: PS82659
2026-03-30 05:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651ed06a-e97c-5b46-a0df-f92c57f58635 with identifier: PS82659
2026-03-30 05:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651ed06a-e97c-5b46-a0df-f92c57f58635 with identifier: PS82659 to the API
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:51Z',
 'fuel_type': 'petrol',
 'id': '651ed06a-e97c-5b46-a0df-f92c57f58635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82659',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 55535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-04',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Edition # 1 passion',
 'transmission': 'manual',
 'trim': 'Edition # 1 passion',
 'year': 2015}
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Saving data for PS82659: {'auction_closing_time': 1774883571.0, 'created_time': 1774639358.570942, 'last_price_update_time': 1774849074.011114}
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82659') HTTP/1.1" 204 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for XC25059: 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for NH67676: 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for TX40216: 2
2026-03-30 05:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00a1b9b6-4293-5489-91f3-19cad4b9e390 with identifier: TX40216
2026-03-30 05:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00a1b9b6-4293-5489-91f3-19cad4b9e390 with scrape type 2
2026-03-30 05:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00a1b9b6-4293-5489-91f3-19cad4b9e390 with scrape type 2
2026-03-30 05:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00a1b9b6-4293-5489-91f3-19cad4b9e390, identifier: TX40216
2026-03-30 05:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00a1b9b6-4293-5489-91f3-19cad4b9e390 with identifier: TX40216
2026-03-30 05:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00a1b9b6-4293-5489-91f3-19cad4b9e390 with identifier: TX40216
2026-03-30 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00a1b9b6-4293-5489-91f3-19cad4b9e390 with identifier: TX40216 to the API
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:41Z',
 'fuel_type': 'diesel',
 'id': '00a1b9b6-4293-5489-91f3-19cad4b9e390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40216',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 66778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Saving data for TX40216: {'auction_closing_time': 1774884281.0, 'created_time': 1774638763.990805, 'last_price_update_time': 1774849074.550373}
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40216') HTTP/1.1" 204 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for AD30182: 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for LX22574: 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for DJ81890: 0
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-30 05:37:54 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-30 05:37:54 [auto1.de] INFO: Scrape type for TJ52961: 2
2026-03-30 05:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b36e591d-e4e1-5e49-969b-b708e6076a75 with identifier: TJ52961
2026-03-30 05:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b36e591d-e4e1-5e49-969b-b708e6076a75 with scrape type 2
2026-03-30 05:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b36e591d-e4e1-5e49-969b-b708e6076a75 with scrape type 2
2026-03-30 05:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b36e591d-e4e1-5e49-969b-b708e6076a75, identifier: TJ52961
2026-03-30 05:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b36e591d-e4e1-5e49-969b-b708e6076a75 with identifier: TJ52961
2026-03-30 05:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b36e591d-e4e1-5e49-969b-b708e6076a75 with identifier: TJ52961
2026-03-30 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b36e591d-e4e1-5e49-969b-b708e6076a75 with identifier: TJ52961 to the API
2026-03-30 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:55:58Z',
 'fuel_type': 'petrol',
 'id': 'b36e591d-e4e1-5e49-969b-b708e6076a75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ52961',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 127528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-02',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Saving data for TJ52961: {'auction_closing_time': 1774886158.0, 'created_time': 1774637039.064962, 'last_price_update_time': 1774849075.76683}
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ52961') HTTP/1.1" 204 0
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Scrape type for PW08848: 0
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-30 05:37:55 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-30 05:37:55 [auto1.de] INFO: Scrape type for AN68791: 2
2026-03-30 05:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with identifier: AN68791
2026-03-30 05:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with scrape type 2
2026-03-30 05:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with scrape type 2
2026-03-30 05:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d, identifier: AN68791
2026-03-30 05:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with identifier: AN68791
2026-03-30 05:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with identifier: AN68791
2026-03-30 05:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f43b77c-7fdd-5f1c-86dd-0263458c4f2d with identifier: AN68791 to the API
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:10Z',
 'fuel_type': 'petrol',
 'id': '1f43b77c-7fdd-5f1c-86dd-0263458c4f2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN68791',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-30',
 'odometer': 40473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seller_name': None,
 'title': 'Mazda CX-30 2.0 Skyactiv-G Mild-Hybrid 2WD',
 'transmission': 'automatic',
 'trim': '2WD',
 'year': 2021}
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-30 05:37:56 [auto1.de] INFO: Saving data for AN68791: {'auction_closing_time': 1774883530.0, 'created_time': 1773659835.317595, 'last_price_update_time': 1774849076.371957}
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN68791') HTTP/1.1" 204 0
2026-03-30 05:37:56 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-30 05:37:56 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-30 05:37:56 [auto1.de] INFO: Scrape type for SP68179: 2
2026-03-30 05:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88eee2da-3703-5d16-b638-8b174161aeb7 with identifier: SP68179
2026-03-30 05:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88eee2da-3703-5d16-b638-8b174161aeb7 with scrape type 2
2026-03-30 05:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88eee2da-3703-5d16-b638-8b174161aeb7 with scrape type 2
2026-03-30 05:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88eee2da-3703-5d16-b638-8b174161aeb7, identifier: SP68179
2026-03-30 05:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88eee2da-3703-5d16-b638-8b174161aeb7 with identifier: SP68179
2026-03-30 05:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88eee2da-3703-5d16-b638-8b174161aeb7 with identifier: SP68179
2026-03-30 05:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88eee2da-3703-5d16-b638-8b174161aeb7 with identifier: SP68179 to the API
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:14:11Z',
 'fuel_type': 'diesel',
 'id': '88eee2da-3703-5d16-b638-8b174161aeb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP68179',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 366388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-10',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-30 05:37:56 [auto1.de] INFO: Saving data for SP68179: {'auction_closing_time': 1774883651.0, 'created_time': 1774521797.773003, 'last_price_update_time': 1774849076.973585}
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP68179') HTTP/1.1" 204 0
2026-03-30 05:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:37:57 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6742 | hits on page: 40
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for NT27416: 2
2026-03-30 05:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with identifier: NT27416
2026-03-30 05:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with scrape type 2
2026-03-30 05:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with scrape type 2
2026-03-30 05:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bd14936-cfcb-5827-b0b1-a0ebcc13be60, identifier: NT27416
2026-03-30 05:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with identifier: NT27416
2026-03-30 05:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with identifier: NT27416
2026-03-30 05:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bd14936-cfcb-5827-b0b1-a0ebcc13be60 with identifier: NT27416 to the API
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:36Z',
 'fuel_type': 'petrol',
 'id': '0bd14936-cfcb-5827-b0b1-a0ebcc13be60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT27416',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 58539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Saving data for NT27416: {'auction_closing_time': 1774885536.0, 'created_time': 1773660243.405228, 'last_price_update_time': 1774849077.471109}
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT27416') HTTP/1.1" 204 0
2026-03-30 05:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for TY58494: 0
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for EU37880: 0
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for CD36674: 0
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-30 05:37:57 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Scrape type for SK54405: 2
2026-03-30 05:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46a6332-f676-56a7-a0d0-790d0ecf07dc with identifier: SK54405
2026-03-30 05:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46a6332-f676-56a7-a0d0-790d0ecf07dc with scrape type 2
2026-03-30 05:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46a6332-f676-56a7-a0d0-790d0ecf07dc with scrape type 2
2026-03-30 05:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46a6332-f676-56a7-a0d0-790d0ecf07dc, identifier: SK54405
2026-03-30 05:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46a6332-f676-56a7-a0d0-790d0ecf07dc with identifier: SK54405
2026-03-30 05:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46a6332-f676-56a7-a0d0-790d0ecf07dc with identifier: SK54405
2026-03-30 05:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46a6332-f676-56a7-a0d0-790d0ecf07dc with identifier: SK54405 to the API
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'diesel',
 'id': 'a46a6332-f676-56a7-a0d0-790d0ecf07dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK54405',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 105531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-04',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2008}
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-30 05:37:57 [auto1.de] INFO: Saving data for SK54405: {'auction_closing_time': 1774884122.0, 'created_time': 1774349779.791128, 'last_price_update_time': 1774849077.95948}
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK54405') HTTP/1.1" 204 0
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-30 05:37:58 [auto1.de] INFO: Scrape type for NW62126: 2
2026-03-30 05:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with identifier: NW62126
2026-03-30 05:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8087711-6ef2-5fd8-9eae-34f7b9a94cb3, identifier: NW62126
2026-03-30 05:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with identifier: NW62126
2026-03-30 05:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with identifier: NW62126
2026-03-30 05:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8087711-6ef2-5fd8-9eae-34f7b9a94cb3 with identifier: NW62126 to the API
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:21:29Z',
 'fuel_type': 'diesel',
 'id': 'f8087711-6ef2-5fd8-9eae-34f7b9a94cb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW62126',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 122147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-30 05:37:58 [auto1.de] INFO: Saving data for NW62126: {'auction_closing_time': 1774884089.0, 'created_time': 1774639464.400822, 'last_price_update_time': 1774849078.45256}
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW62126') HTTP/1.1" 204 0
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-30 05:37:58 [auto1.de] INFO: Scrape type for JG35044: 2
2026-03-30 05:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with identifier: JG35044
2026-03-30 05:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28837bfd-82cc-56d8-b2c1-3029d15c9dfd, identifier: JG35044
2026-03-30 05:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with identifier: JG35044
2026-03-30 05:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with identifier: JG35044
2026-03-30 05:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28837bfd-82cc-56d8-b2c1-3029d15c9dfd with identifier: JG35044 to the API
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:54Z',
 'fuel_type': 'diesel',
 'id': '28837bfd-82cc-56d8-b2c1-3029d15c9dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG35044',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 163312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-30 05:37:58 [auto1.de] INFO: Saving data for JG35044: {'auction_closing_time': 1774884294.0, 'created_time': 1773686541.418483, 'last_price_update_time': 1774849078.849728}
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG35044') HTTP/1.1" 204 0
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-30 05:37:58 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-30 05:37:58 [auto1.de] INFO: Scrape type for BW05751: 2
2026-03-30 05:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with identifier: BW05751
2026-03-30 05:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with scrape type 2
2026-03-30 05:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f315293-c43d-5498-b7bf-5fecf4ba2e14, identifier: BW05751
2026-03-30 05:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with identifier: BW05751
2026-03-30 05:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with identifier: BW05751
2026-03-30 05:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f315293-c43d-5498-b7bf-5fecf4ba2e14 with identifier: BW05751 to the API
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'electro',
 'id': '0f315293-c43d-5498-b7bf-5fecf4ba2e14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW05751',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 87160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Audi e-tron 50 quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Saving data for BW05751: {'auction_closing_time': 1774884351.0, 'created_time': 1773340340.309214, 'last_price_update_time': 1774849079.247975}
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW05751') HTTP/1.1" 204 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for SY19126: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for CE31107: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for BN03285: 2
2026-03-30 05:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 05:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99bff1b3-6844-5928-8474-43fdcb0ec786 with scrape type 2
2026-03-30 05:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99bff1b3-6844-5928-8474-43fdcb0ec786 with scrape type 2
2026-03-30 05:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99bff1b3-6844-5928-8474-43fdcb0ec786, identifier: BN03285
2026-03-30 05:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 05:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285
2026-03-30 05:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99bff1b3-6844-5928-8474-43fdcb0ec786 with identifier: BN03285 to the API
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:08:50Z',
 'fuel_type': 'petrol',
 'id': '99bff1b3-6844-5928-8474-43fdcb0ec786',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN03285',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 142434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-15',
 'seller_name': None,
 'title': 'Volvo S60 2.4 T AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2002}
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Saving data for BN03285: {'auction_closing_time': 1774883330.0, 'created_time': 1774549930.481701, 'last_price_update_time': 1774849079.775081}
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN03285') HTTP/1.1" 204 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for MM04684: 0
2026-03-30 05:37:59 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-30 05:37:59 [auto1.de] INFO: Scrape type for SZ04450: 2
2026-03-30 05:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 629217c5-f96a-5589-9b93-15a4a0b62f5b with identifier: SZ04450
2026-03-30 05:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 629217c5-f96a-5589-9b93-15a4a0b62f5b with scrape type 2
2026-03-30 05:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 629217c5-f96a-5589-9b93-15a4a0b62f5b with scrape type 2
2026-03-30 05:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 629217c5-f96a-5589-9b93-15a4a0b62f5b, identifier: SZ04450
2026-03-30 05:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 629217c5-f96a-5589-9b93-15a4a0b62f5b with identifier: SZ04450
2026-03-30 05:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 629217c5-f96a-5589-9b93-15a4a0b62f5b with identifier: SZ04450
2026-03-30 05:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 629217c5-f96a-5589-9b93-15a4a0b62f5b with identifier: SZ04450 to the API
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:26:30Z',
 'fuel_type': 'petrol',
 'id': '629217c5-f96a-5589-9b93-15a4a0b62f5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ04450',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 83732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-26',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 SIDI Turbo Color Innovation Start/Stop 4x4',
 'transmission': 'automatic',
 'trim': 'Color Innovation Start/Stop 4x4',
 'year': 2017}
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-30 05:38:00 [auto1.de] INFO: Saving data for SZ04450: {'auction_closing_time': 1774884390.0, 'created_time': 1773860934.690754, 'last_price_update_time': 1774849080.323829}
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ04450') HTTP/1.1" 204 0
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-30 05:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:00 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-30 05:38:00 [auto1.de] INFO: Scrape type for KG96622: 2
2026-03-30 05:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 751f0f81-591e-5438-b1d3-8f285e699632 with identifier: KG96622
2026-03-30 05:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 751f0f81-591e-5438-b1d3-8f285e699632 with scrape type 2
2026-03-30 05:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 751f0f81-591e-5438-b1d3-8f285e699632 with scrape type 2
2026-03-30 05:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 751f0f81-591e-5438-b1d3-8f285e699632, identifier: KG96622
2026-03-30 05:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 751f0f81-591e-5438-b1d3-8f285e699632 with identifier: KG96622
2026-03-30 05:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 751f0f81-591e-5438-b1d3-8f285e699632 with identifier: KG96622
2026-03-30 05:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 751f0f81-591e-5438-b1d3-8f285e699632 with identifier: KG96622 to the API
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:08:45Z',
 'fuel_type': 'petrol',
 'id': '751f0f81-591e-5438-b1d3-8f285e699632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG96622',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 124226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Urban Style Edition',
 'transmission': 'automatic',
 'trim': 'Urban Style Edition',
 'year': 2018}
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-30 05:38:00 [auto1.de] INFO: Saving data for KG96622: {'auction_closing_time': 1774883325.0, 'created_time': 1774638272.688444, 'last_price_update_time': 1774849080.863098}
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG96622') HTTP/1.1" 204 0
2026-03-30 05:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-30 05:38:00 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-30 05:38:00 [auto1.de] INFO: Scrape type for FN92851: 2
2026-03-30 05:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cecc9377-9888-562f-b1ef-e98f418fae65 with identifier: FN92851
2026-03-30 05:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cecc9377-9888-562f-b1ef-e98f418fae65 with scrape type 2
2026-03-30 05:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cecc9377-9888-562f-b1ef-e98f418fae65 with scrape type 2
2026-03-30 05:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cecc9377-9888-562f-b1ef-e98f418fae65, identifier: FN92851
2026-03-30 05:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cecc9377-9888-562f-b1ef-e98f418fae65 with identifier: FN92851
2026-03-30 05:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cecc9377-9888-562f-b1ef-e98f418fae65 with identifier: FN92851
2026-03-30 05:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cecc9377-9888-562f-b1ef-e98f418fae65 with identifier: FN92851 to the API
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:41:23Z',
 'fuel_type': 'petrol',
 'id': 'cecc9377-9888-562f-b1ef-e98f418fae65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN92851',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 21250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Mild-Hybrid 4Matic AMG Line '
          'Edition',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line Edition',
 'year': 2024}
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Saving data for FN92851: {'auction_closing_time': 1774885283.0, 'created_time': 1774637564.76508, 'last_price_update_time': 1774849081.269215}
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN92851') HTTP/1.1" 204 0
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Scrape type for WP78953: 2
2026-03-30 05:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93923334-1838-5470-a2ef-dee9469f67e6 with identifier: WP78953
2026-03-30 05:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93923334-1838-5470-a2ef-dee9469f67e6 with scrape type 2
2026-03-30 05:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93923334-1838-5470-a2ef-dee9469f67e6 with scrape type 2
2026-03-30 05:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93923334-1838-5470-a2ef-dee9469f67e6, identifier: WP78953
2026-03-30 05:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93923334-1838-5470-a2ef-dee9469f67e6 with identifier: WP78953
2026-03-30 05:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93923334-1838-5470-a2ef-dee9469f67e6 with identifier: WP78953
2026-03-30 05:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93923334-1838-5470-a2ef-dee9469f67e6 with identifier: WP78953 to the API
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': '93923334-1838-5470-a2ef-dee9469f67e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP78953',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 83152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-13',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Saving data for WP78953: {'auction_closing_time': 1774885968.0, 'created_time': 1774032568.188047, 'last_price_update_time': 1774849081.830642}
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP78953') HTTP/1.1" 204 0
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-30 05:38:01 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-30 05:38:01 [auto1.de] INFO: Scrape type for ZJ71499: 2
2026-03-30 05:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-30 05:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with scrape type 2
2026-03-30 05:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with scrape type 2
2026-03-30 05:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d, identifier: ZJ71499
2026-03-30 05:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-30 05:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499
2026-03-30 05:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fab48df-72d6-50e0-b811-d2ad8af9ba0d with identifier: ZJ71499 to the API
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:57:47Z',
 'fuel_type': 'petrol',
 'id': '4fab48df-72d6-50e0-b811-d2ad8af9ba0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ71499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 111503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-30 05:38:02 [auto1.de] INFO: Saving data for ZJ71499: {'auction_closing_time': 1774886267.0, 'created_time': 1774550456.998837, 'last_price_update_time': 1774849082.274451}
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ71499') HTTP/1.1" 204 0
2026-03-30 05:38:02 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-30 05:38:02 [auto1.de] INFO: Scrape type for PR50786: 2
2026-03-30 05:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-30 05:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with scrape type 2
2026-03-30 05:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with scrape type 2
2026-03-30 05:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f, identifier: PR50786
2026-03-30 05:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-30 05:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786
2026-03-30 05:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 700ce3f2-ebe7-57cd-a8a3-1274990e9a5f with identifier: PR50786 to the API
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:59:23Z',
 'fuel_type': 'petrol',
 'id': '700ce3f2-ebe7-57cd-a8a3-1274990e9a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR50786',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 48431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-09',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 FSI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-30 05:38:02 [auto1.de] INFO: Saving data for PR50786: {'auction_closing_time': 1774886363.0, 'created_time': 1774552155.503366, 'last_price_update_time': 1774849082.791192}
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR50786') HTTP/1.1" 204 0
2026-03-30 05:38:02 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-30 05:38:02 [auto1.de] INFO: Scrape type for ZU57618: 2
2026-03-30 05:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-30 05:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with scrape type 2
2026-03-30 05:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with scrape type 2
2026-03-30 05:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80b95fbd-9462-5f77-8e64-abc37ab5ef73, identifier: ZU57618
2026-03-30 05:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-30 05:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618
2026-03-30 05:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80b95fbd-9462-5f77-8e64-abc37ab5ef73 with identifier: ZU57618 to the API
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:13:25Z',
 'fuel_type': 'petrol',
 'id': '80b95fbd-9462-5f77-8e64-abc37ab5ef73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU57618',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 14451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Saving data for ZU57618: {'auction_closing_time': 1774883605.0, 'created_time': 1774552742.904132, 'last_price_update_time': 1774849083.197634}
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU57618') HTTP/1.1" 204 0
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Scrape type for LX45168: 2
2026-03-30 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-30 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with scrape type 2
2026-03-30 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with scrape type 2
2026-03-30 05:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc, identifier: LX45168
2026-03-30 05:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-30 05:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168
2026-03-30 05:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27cad707-89bf-54cd-b19f-3d12f0ad4dfc with identifier: LX45168 to the API
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:29:21Z',
 'fuel_type': 'petrol',
 'id': '27cad707-89bf-54cd-b19f-3d12f0ad4dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX45168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 78850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-17',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Saving data for LX45168: {'auction_closing_time': 1774884561.0, 'created_time': 1774552629.582714, 'last_price_update_time': 1774849083.615438}
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX45168') HTTP/1.1" 204 0
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Scrape type for BX95848: 0
2026-03-30 05:38:03 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-30 05:38:03 [auto1.de] INFO: Scrape type for DZ36531: 2
2026-03-30 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a50f95-7b8d-5837-a70a-32825dd6e225 with identifier: DZ36531
2026-03-30 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a50f95-7b8d-5837-a70a-32825dd6e225 with scrape type 2
2026-03-30 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a50f95-7b8d-5837-a70a-32825dd6e225 with scrape type 2
2026-03-30 05:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9a50f95-7b8d-5837-a70a-32825dd6e225, identifier: DZ36531
2026-03-30 05:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9a50f95-7b8d-5837-a70a-32825dd6e225 with identifier: DZ36531
2026-03-30 05:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9a50f95-7b8d-5837-a70a-32825dd6e225 with identifier: DZ36531
2026-03-30 05:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9a50f95-7b8d-5837-a70a-32825dd6e225 with identifier: DZ36531 to the API
2026-03-30 05:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:19Z',
 'fuel_type': 'diesel',
 'id': 'c9a50f95-7b8d-5837-a70a-32825dd6e225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ36531',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 94880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-27',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-30 05:38:04 [auto1.de] INFO: Saving data for DZ36531: {'auction_closing_time': 1774883899.0, 'created_time': 1774638287.38515, 'last_price_update_time': 1774849084.117681}
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ36531') HTTP/1.1" 204 0
2026-03-30 05:38:04 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-30 05:38:04 [auto1.de] INFO: Scrape type for MV67104: 2
2026-03-30 05:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 632cb024-acce-5d52-84a4-096f377d5e81 with identifier: MV67104
2026-03-30 05:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 632cb024-acce-5d52-84a4-096f377d5e81 with scrape type 2
2026-03-30 05:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 632cb024-acce-5d52-84a4-096f377d5e81 with scrape type 2
2026-03-30 05:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 632cb024-acce-5d52-84a4-096f377d5e81, identifier: MV67104
2026-03-30 05:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 632cb024-acce-5d52-84a4-096f377d5e81 with identifier: MV67104
2026-03-30 05:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 632cb024-acce-5d52-84a4-096f377d5e81 with identifier: MV67104
2026-03-30 05:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 632cb024-acce-5d52-84a4-096f377d5e81 with identifier: MV67104 to the API
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'diesel',
 'id': '632cb024-acce-5d52-84a4-096f377d5e81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV67104',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 294526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-30 05:38:04 [auto1.de] INFO: Saving data for MV67104: {'auction_closing_time': 1774883794.0, 'created_time': 1774034475.537056, 'last_price_update_time': 1774849084.643461}
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV67104') HTTP/1.1" 204 0
2026-03-30 05:38:04 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-30 05:38:04 [auto1.de] INFO: Scrape type for CF55359: 2
2026-03-30 05:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03db1699-785d-595d-8612-a47eaf5bff5b with identifier: CF55359
2026-03-30 05:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03db1699-785d-595d-8612-a47eaf5bff5b with scrape type 2
2026-03-30 05:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03db1699-785d-595d-8612-a47eaf5bff5b with scrape type 2
2026-03-30 05:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03db1699-785d-595d-8612-a47eaf5bff5b, identifier: CF55359
2026-03-30 05:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03db1699-785d-595d-8612-a47eaf5bff5b with identifier: CF55359
2026-03-30 05:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03db1699-785d-595d-8612-a47eaf5bff5b with identifier: CF55359
2026-03-30 05:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03db1699-785d-595d-8612-a47eaf5bff5b with identifier: CF55359 to the API
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'petrol',
 'id': '03db1699-785d-595d-8612-a47eaf5bff5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF55359',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 19236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-09',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-30 05:38:05 [auto1.de] INFO: Saving data for CF55359: {'auction_closing_time': 1774886316.0, 'created_time': 1774638301.721263, 'last_price_update_time': 1774849085.055828}
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF55359') HTTP/1.1" 204 0
2026-03-30 05:38:05 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-30 05:38:05 [auto1.de] INFO: Scrape type for GK88230: 2
2026-03-30 05:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac515153-aba4-5781-86c0-6616deadab14 with identifier: GK88230
2026-03-30 05:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac515153-aba4-5781-86c0-6616deadab14 with scrape type 2
2026-03-30 05:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac515153-aba4-5781-86c0-6616deadab14 with scrape type 2
2026-03-30 05:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac515153-aba4-5781-86c0-6616deadab14, identifier: GK88230
2026-03-30 05:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac515153-aba4-5781-86c0-6616deadab14 with identifier: GK88230
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-30 05:38:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac515153-aba4-5781-86c0-6616deadab14 with identifier: GK88230
2026-03-30 05:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac515153-aba4-5781-86c0-6616deadab14 with identifier: GK88230 to the API
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:15:01Z',
 'fuel_type': 'petrol',
 'id': 'ac515153-aba4-5781-86c0-6616deadab14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK88230',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 11901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-24',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2022}
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-30 05:38:05 [auto1.de] INFO: Saving data for GK88230: {'auction_closing_time': 1774883701.0, 'created_time': 1773229131.26761, 'last_price_update_time': 1774849085.742539}
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK88230') HTTP/1.1" 204 0
2026-03-30 05:38:05 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-30 05:38:05 [auto1.de] INFO: Scrape type for XM77164: 2
2026-03-30 05:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-30 05:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca21b18-13fc-5399-80e6-9350d36fa963 with scrape type 2
2026-03-30 05:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ca21b18-13fc-5399-80e6-9350d36fa963 with scrape type 2
2026-03-30 05:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ca21b18-13fc-5399-80e6-9350d36fa963, identifier: XM77164
2026-03-30 05:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-30 05:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164
2026-03-30 05:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ca21b18-13fc-5399-80e6-9350d36fa963 with identifier: XM77164 to the API
2026-03-30 05:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:01:52Z',
 'fuel_type': 'petrol',
 'id': '0ca21b18-13fc-5399-80e6-9350d36fa963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM77164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 96283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2016}
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Saving data for XM77164: {'auction_closing_time': 1774882912.0, 'created_time': 1774550441.558277, 'last_price_update_time': 1774849086.148618}
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XM77164') HTTP/1.1" 204 0
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Scrape type for ZL38204: 2
2026-03-30 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 439a6fa7-bb63-503b-9309-391fd5d76572 with identifier: ZL38204
2026-03-30 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 439a6fa7-bb63-503b-9309-391fd5d76572 with scrape type 2
2026-03-30 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 439a6fa7-bb63-503b-9309-391fd5d76572 with scrape type 2
2026-03-30 05:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 439a6fa7-bb63-503b-9309-391fd5d76572, identifier: ZL38204
2026-03-30 05:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 439a6fa7-bb63-503b-9309-391fd5d76572 with identifier: ZL38204
2026-03-30 05:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 439a6fa7-bb63-503b-9309-391fd5d76572 with identifier: ZL38204
2026-03-30 05:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 439a6fa7-bb63-503b-9309-391fd5d76572 with identifier: ZL38204 to the API
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:06:28Z',
 'fuel_type': 'diesel',
 'id': '439a6fa7-bb63-503b-9309-391fd5d76572',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL38204',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 161864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-22',
 'seller_name': None,
 'title': 'Opel Combo 1.7 CDTI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2007}
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Saving data for ZL38204: {'auction_closing_time': 1774883188.0, 'created_time': 1774549864.41815, 'last_price_update_time': 1774849086.583246}
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL38204') HTTP/1.1" 204 0
2026-03-30 05:38:06 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-30 05:38:06 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-30 05:38:06 [auto1.de] INFO: Scrape type for UU35907: 2
2026-03-30 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with identifier: UU35907
2026-03-30 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with scrape type 2
2026-03-30 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with scrape type 2
2026-03-30 05:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a, identifier: UU35907
2026-03-30 05:38:06 [scrapy.extensions.logstats] INFO: Crawled 99 pages (at 13 pages/min), scraped 608 items (at 114 items/min)
2026-03-30 05:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with identifier: UU35907
2026-03-30 05:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with identifier: UU35907
2026-03-30 05:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cbb7fbf-1f02-50de-9c1f-8876225f1b4a with identifier: UU35907 to the API
2026-03-30 05:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:42:07Z',
 'fuel_type': 'diesel',
 'id': '8cbb7fbf-1f02-50de-9c1f-8876225f1b4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU35907',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Saving data for UU35907: {'auction_closing_time': 1774885327.0, 'created_time': 1774549872.648378, 'last_price_update_time': 1774849087.118824}
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU35907') HTTP/1.1" 204 0
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for AG38936: 2
2026-03-30 05:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-30 05:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with scrape type 2
2026-03-30 05:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with scrape type 2
2026-03-30 05:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d758cdc6-c644-5df0-96be-71b2ce8e3fd6, identifier: AG38936
2026-03-30 05:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-30 05:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-30 05:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936
2026-03-30 05:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d758cdc6-c644-5df0-96be-71b2ce8e3fd6 with identifier: AG38936 to the API
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:35Z',
 'fuel_type': 'diesel',
 'id': 'd758cdc6-c644-5df0-96be-71b2ce8e3fd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG38936',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 280796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Saving data for AG38936: {'auction_closing_time': 1774885655.0, 'created_time': 1773917253.086387, 'last_price_update_time': 1774849087.573423}
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG38936') HTTP/1.1" 204 0
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for ZE67546: 0
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 05:38:07 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-30 05:38:07 [auto1.de] INFO: Scrape type for GC08315: 2
2026-03-30 05:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-30 05:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 943a368f-5e49-52a4-b93e-d133bd320dcd with scrape type 2
2026-03-30 05:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 943a368f-5e49-52a4-b93e-d133bd320dcd with scrape type 2
2026-03-30 05:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 943a368f-5e49-52a4-b93e-d133bd320dcd, identifier: GC08315
2026-03-30 05:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-30 05:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315
2026-03-30 05:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 943a368f-5e49-52a4-b93e-d133bd320dcd with identifier: GC08315 to the API
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': '943a368f-5e49-52a4-b93e-d133bd320dcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC08315',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 33300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Saving data for GC08315: {'auction_closing_time': 1774885242.0, 'created_time': 1774552615.721608, 'last_price_update_time': 1774849088.106446}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC08315') HTTP/1.1" 204 0
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Scrape type for MJ66272: 2
2026-03-30 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a507adf9-586a-5d51-bf7b-127d3fe91826 with identifier: MJ66272
2026-03-30 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a507adf9-586a-5d51-bf7b-127d3fe91826 with scrape type 2
2026-03-30 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a507adf9-586a-5d51-bf7b-127d3fe91826 with scrape type 2
2026-03-30 05:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a507adf9-586a-5d51-bf7b-127d3fe91826, identifier: MJ66272
2026-03-30 05:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a507adf9-586a-5d51-bf7b-127d3fe91826 with identifier: MJ66272
2026-03-30 05:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a507adf9-586a-5d51-bf7b-127d3fe91826 with identifier: MJ66272
2026-03-30 05:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a507adf9-586a-5d51-bf7b-127d3fe91826 with identifier: MJ66272 to the API
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:01Z',
 'fuel_type': 'petrol',
 'id': 'a507adf9-586a-5d51-bf7b-127d3fe91826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ66272',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 156878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-06',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 FSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2005}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Saving data for MJ66272: {'auction_closing_time': 1774883581.0, 'created_time': 1774638290.649013, 'last_price_update_time': 1774849088.505426}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ66272') HTTP/1.1" 204 0
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Scrape type for DN96798: 2
2026-03-30 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-30 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09abb2f7-841d-5eb6-a34f-d66988aba860 with scrape type 2
2026-03-30 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09abb2f7-841d-5eb6-a34f-d66988aba860 with scrape type 2
2026-03-30 05:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09abb2f7-841d-5eb6-a34f-d66988aba860, identifier: DN96798
2026-03-30 05:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-30 05:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798
2026-03-30 05:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09abb2f7-841d-5eb6-a34f-d66988aba860 with identifier: DN96798 to the API
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:45:00Z',
 'fuel_type': 'diesel',
 'id': '09abb2f7-841d-5eb6-a34f-d66988aba860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96798',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 103579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Saving data for DN96798: {'auction_closing_time': 1774885500.0, 'created_time': 1773916241.605163, 'last_price_update_time': 1774849088.959097}
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN96798') HTTP/1.1" 204 0
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 05:38:08 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-30 05:38:08 [auto1.de] INFO: Scrape type for XF58855: 2
2026-03-30 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-30 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with scrape type 2
2026-03-30 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with scrape type 2
2026-03-30 05:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b, identifier: XF58855
2026-03-30 05:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-30 05:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855
2026-03-30 05:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b with identifier: XF58855 to the API
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:26:32Z',
 'fuel_type': 'petrol',
 'id': '9c2bda2c-56f9-59ce-8f9e-e03f4285eb0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF58855',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Tiida',
 'odometer': 240110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Nissan Tiida 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2010}
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-30 05:38:09 [auto1.de] INFO: Saving data for XF58855: {'auction_closing_time': 1774884392.0, 'created_time': 1774552924.513874, 'last_price_update_time': 1774849089.387598}
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF58855') HTTP/1.1" 204 0
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-30 05:38:09 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-30 05:38:09 [auto1.de] INFO: Scrape type for DA14400: 2
2026-03-30 05:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990a4cf0-80f9-518d-a36b-47c2e36a0aee with identifier: DA14400
2026-03-30 05:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990a4cf0-80f9-518d-a36b-47c2e36a0aee with scrape type 2
2026-03-30 05:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 990a4cf0-80f9-518d-a36b-47c2e36a0aee with scrape type 2
2026-03-30 05:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 990a4cf0-80f9-518d-a36b-47c2e36a0aee, identifier: DA14400
2026-03-30 05:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 990a4cf0-80f9-518d-a36b-47c2e36a0aee with identifier: DA14400
2026-03-30 05:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 990a4cf0-80f9-518d-a36b-47c2e36a0aee with identifier: DA14400
2026-03-30 05:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 990a4cf0-80f9-518d-a36b-47c2e36a0aee with identifier: DA14400 to the API
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'petrol',
 'id': '990a4cf0-80f9-518d-a36b-47c2e36a0aee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA14400',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 55629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-08',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2024}
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-30 05:38:09 [auto1.de] INFO: Saving data for DA14400: {'auction_closing_time': 1774883836.0, 'created_time': 1773830705.97877, 'last_price_update_time': 1774849089.915587}
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA14400') HTTP/1.1" 204 0
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-30 05:38:09 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-30 05:38:09 [auto1.de] INFO: Scrape type for BW69940: 2
2026-03-30 05:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-30 05:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b702739f-96a4-58f0-87c3-ed9c40e18978 with scrape type 2
2026-03-30 05:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b702739f-96a4-58f0-87c3-ed9c40e18978 with scrape type 2
2026-03-30 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b702739f-96a4-58f0-87c3-ed9c40e18978, identifier: BW69940
2026-03-30 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-30 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940
2026-03-30 05:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b702739f-96a4-58f0-87c3-ed9c40e18978 with identifier: BW69940 to the API
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:09:38Z',
 'fuel_type': 'diesel',
 'id': 'b702739f-96a4-58f0-87c3-ed9c40e18978',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW69940',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 129836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Saving data for BW69940: {'auction_closing_time': 1774883378.0, 'created_time': 1774467396.528103, 'last_price_update_time': 1774849090.323028}
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW69940') HTTP/1.1" 204 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for JT26189: 2
2026-03-30 05:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59223b0f-59bd-50bd-aa57-3a58bd39a862 with identifier: JT26189
2026-03-30 05:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59223b0f-59bd-50bd-aa57-3a58bd39a862 with scrape type 2
2026-03-30 05:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59223b0f-59bd-50bd-aa57-3a58bd39a862 with scrape type 2
2026-03-30 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59223b0f-59bd-50bd-aa57-3a58bd39a862, identifier: JT26189
2026-03-30 05:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59223b0f-59bd-50bd-aa57-3a58bd39a862 with identifier: JT26189
2026-03-30 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59223b0f-59bd-50bd-aa57-3a58bd39a862 with identifier: JT26189
2026-03-30 05:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59223b0f-59bd-50bd-aa57-3a58bd39a862 with identifier: JT26189 to the API
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:07:06Z',
 'fuel_type': 'diesel',
 'id': '59223b0f-59bd-50bd-aa57-3a58bd39a862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT26189',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 93110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Tekna 4x4',
 'transmission': 'manual',
 'trim': 'Tekna 4x4',
 'year': 2016}
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Saving data for JT26189: {'auction_closing_time': 1774883226.0, 'created_time': 1773466771.248082, 'last_price_update_time': 1774849090.793419}
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT26189') HTTP/1.1" 204 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for GL29302: 0
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-30 05:38:10 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-30 05:38:10 [auto1.de] INFO: Scrape type for LM46602: 2
2026-03-30 05:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-30 05:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ebf77e-8661-5c8c-9380-a600fe4ba38a with scrape type 2
2026-03-30 05:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60ebf77e-8661-5c8c-9380-a600fe4ba38a with scrape type 2
2026-03-30 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60ebf77e-8661-5c8c-9380-a600fe4ba38a, identifier: LM46602
2026-03-30 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-30 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602
2026-03-30 05:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60ebf77e-8661-5c8c-9380-a600fe4ba38a with identifier: LM46602 to the API
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:59Z',
 'fuel_type': 'petrol',
 'id': '60ebf77e-8661-5c8c-9380-a600fe4ba38a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM46602',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 106381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Saving data for LM46602: {'auction_closing_time': 1774882859.0, 'created_time': 1774550642.446887, 'last_price_update_time': 1774849091.271802}
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM46602') HTTP/1.1" 204 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for VY57936: 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for EE67524: 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for HA16942: 0
2026-03-30 05:38:11 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for NG74955: 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for UM69189: 2
2026-03-30 05:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abc2393-3012-5ddd-8a44-451b8b377af1 with identifier: UM69189
2026-03-30 05:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abc2393-3012-5ddd-8a44-451b8b377af1 with scrape type 2
2026-03-30 05:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4abc2393-3012-5ddd-8a44-451b8b377af1 with scrape type 2
2026-03-30 05:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4abc2393-3012-5ddd-8a44-451b8b377af1, identifier: UM69189
2026-03-30 05:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4abc2393-3012-5ddd-8a44-451b8b377af1 with identifier: UM69189
2026-03-30 05:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4abc2393-3012-5ddd-8a44-451b8b377af1 with identifier: UM69189
2026-03-30 05:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4abc2393-3012-5ddd-8a44-451b8b377af1 with identifier: UM69189 to the API
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'petrol',
 'id': '4abc2393-3012-5ddd-8a44-451b8b377af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM69189',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pixo',
 'odometer': 181054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-30',
 'seller_name': None,
 'title': 'Nissan Pixo 1.0 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2012}
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Saving data for UM69189: {'auction_closing_time': 1774883358.0, 'created_time': 1774550435.787314, 'last_price_update_time': 1774849091.893663}
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM69189') HTTP/1.1" 204 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-30 05:38:11 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-30 05:38:11 [auto1.de] INFO: Scrape type for GL61675: 2
2026-03-30 05:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with identifier: GL61675
2026-03-30 05:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with scrape type 2
2026-03-30 05:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with scrape type 2
2026-03-30 05:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84dd0295-d617-5ff1-b3dc-cfc16f820be1, identifier: GL61675
2026-03-30 05:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with identifier: GL61675
2026-03-30 05:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with identifier: GL61675
2026-03-30 05:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84dd0295-d617-5ff1-b3dc-cfc16f820be1 with identifier: GL61675 to the API
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:03:53Z',
 'fuel_type': 'petrol',
 'id': '84dd0295-d617-5ff1-b3dc-cfc16f820be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61675',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 68224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-18',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2022}
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-30 05:38:12 [auto1.de] INFO: Saving data for GL61675: {'auction_closing_time': 1774883033.0, 'created_time': 1774034268.607284, 'last_price_update_time': 1774849092.331151}
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL61675') HTTP/1.1" 204 0
2026-03-30 05:38:12 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-30 05:38:12 [auto1.de] INFO: Scrape type for VH78642: 2
2026-03-30 05:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with identifier: VH78642
2026-03-30 05:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with scrape type 2
2026-03-30 05:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with scrape type 2
2026-03-30 05:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b55d393-8ceb-5f42-a75d-b19a2dab9a10, identifier: VH78642
2026-03-30 05:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with identifier: VH78642
2026-03-30 05:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with identifier: VH78642
2026-03-30 05:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b55d393-8ceb-5f42-a75d-b19a2dab9a10 with identifier: VH78642 to the API
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': '9b55d393-8ceb-5f42-a75d-b19a2dab9a10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH78642',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 170996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-20',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Clever',
 'transmission': 'manual',
 'trim': 'Clever',
 'year': 2018}
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-30 05:38:12 [auto1.de] INFO: Saving data for VH78642: {'auction_closing_time': 1774884638.0, 'created_time': 1774637132.987481, 'last_price_update_time': 1774849092.84644}
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH78642') HTTP/1.1" 204 0
2026-03-30 05:38:12 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-30 05:38:12 [auto1.de] INFO: Scrape type for FL30108: 2
2026-03-30 05:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-30 05:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52a025a5-8664-517c-86d3-39d1464312cd with scrape type 2
2026-03-30 05:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52a025a5-8664-517c-86d3-39d1464312cd with scrape type 2
2026-03-30 05:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52a025a5-8664-517c-86d3-39d1464312cd, identifier: FL30108
2026-03-30 05:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-30 05:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108
2026-03-30 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52a025a5-8664-517c-86d3-39d1464312cd with identifier: FL30108 to the API
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:45Z',
 'fuel_type': 'petrol',
 'id': '52a025a5-8664-517c-86d3-39d1464312cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL30108',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 70712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-10',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Saving data for FL30108: {'auction_closing_time': 1774884345.0, 'created_time': 1774589459.046878, 'last_price_update_time': 1774849093.271856}
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL30108') HTTP/1.1" 204 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for BW06132: 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for KY67779: 2
2026-03-30 05:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-30 05:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c4b51a-0957-51e0-90e8-b89f951ed411 with scrape type 2
2026-03-30 05:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c4b51a-0957-51e0-90e8-b89f951ed411 with scrape type 2
2026-03-30 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c4b51a-0957-51e0-90e8-b89f951ed411, identifier: KY67779
2026-03-30 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-30 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779
2026-03-30 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c4b51a-0957-51e0-90e8-b89f951ed411 with identifier: KY67779 to the API
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:00:46Z',
 'fuel_type': 'diesel',
 'id': 'e8c4b51a-0957-51e0-90e8-b89f951ed411',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY67779',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Saving data for KY67779: {'auction_closing_time': 1774882846.0, 'created_time': 1774550422.090237, 'last_price_update_time': 1774849093.765114}
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY67779') HTTP/1.1" 204 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-30 05:38:13 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-30 05:38:13 [auto1.de] INFO: Scrape type for WJ94391: 2
2026-03-30 05:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-30 05:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with scrape type 2
2026-03-30 05:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with scrape type 2
2026-03-30 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77, identifier: WJ94391
2026-03-30 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-30 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391
2026-03-30 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25fc022a-5ae3-5f71-8b08-2bc5423e4d77 with identifier: WJ94391 to the API
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:36:31Z',
 'fuel_type': 'petrol',
 'id': '25fc022a-5ae3-5f71-8b08-2bc5423e4d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ94391',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 46789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2020}
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Saving data for WJ94391: {'auction_closing_time': 1774884991.0, 'created_time': 1774552200.173243, 'last_price_update_time': 1774849094.200289}
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ94391') HTTP/1.1" 204 0
2026-03-30 05:38:14 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Scrape type for KM78395: 2
2026-03-30 05:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb9b6d19-930c-5353-b572-033c62cba68c with identifier: KM78395
2026-03-30 05:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb9b6d19-930c-5353-b572-033c62cba68c with scrape type 2
2026-03-30 05:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb9b6d19-930c-5353-b572-033c62cba68c with scrape type 2
2026-03-30 05:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb9b6d19-930c-5353-b572-033c62cba68c, identifier: KM78395
2026-03-30 05:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb9b6d19-930c-5353-b572-033c62cba68c with identifier: KM78395
2026-03-30 05:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb9b6d19-930c-5353-b572-033c62cba68c with identifier: KM78395
2026-03-30 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb9b6d19-930c-5353-b572-033c62cba68c with identifier: KM78395 to the API
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:11:02Z',
 'fuel_type': 'petrol',
 'id': 'cb9b6d19-930c-5353-b572-033c62cba68c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM78395',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 49034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Audi A4 Allroad 45 TFSI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Saving data for KM78395: {'auction_closing_time': 1774883462.0, 'created_time': 1773946166.179854, 'last_price_update_time': 1774849094.711544}
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM78395') HTTP/1.1" 204 0
2026-03-30 05:38:14 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-30 05:38:14 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-30 05:38:14 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Scrape type for LW85167: 0
2026-03-30 05:38:14 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-30 05:38:14 [auto1.de] INFO: Scrape type for UH78050: 2
2026-03-30 05:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-30 05:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d7f31d-6269-59aa-978b-a4a75741fb08 with scrape type 2
2026-03-30 05:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d7f31d-6269-59aa-978b-a4a75741fb08 with scrape type 2
2026-03-30 05:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d7f31d-6269-59aa-978b-a4a75741fb08, identifier: UH78050
2026-03-30 05:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-30 05:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050
2026-03-30 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d7f31d-6269-59aa-978b-a4a75741fb08 with identifier: UH78050 to the API
2026-03-30 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:39Z',
 'fuel_type': 'diesel',
 'id': '86d7f31d-6269-59aa-978b-a4a75741fb08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH78050',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 139149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2020}
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Saving data for UH78050: {'auction_closing_time': 1774883319.0, 'created_time': 1774552830.799241, 'last_price_update_time': 1774849095.134298}
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH78050') HTTP/1.1" 204 0
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Scrape type for CW13893: 2
2026-03-30 05:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-30 05:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with scrape type 2
2026-03-30 05:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with scrape type 2
2026-03-30 05:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0, identifier: CW13893
2026-03-30 05:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-30 05:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893
2026-03-30 05:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0 with identifier: CW13893 to the API
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:35:02Z',
 'fuel_type': 'petrol',
 'id': 'f7c8f8ae-acfb-5758-803a-d34e4a0f3ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW13893',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 169296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Saving data for CW13893: {'auction_closing_time': 1774884902.0, 'created_time': 1774589455.789927, 'last_price_update_time': 1774849095.544501}
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW13893') HTTP/1.1" 204 0
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-30 05:38:15 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-30 05:38:15 [auto1.de] INFO: Scrape type for HL58412: 2
2026-03-30 05:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-30 05:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d7679a-6128-5203-ba72-ad94d328f46b with scrape type 2
2026-03-30 05:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d7679a-6128-5203-ba72-ad94d328f46b with scrape type 2
2026-03-30 05:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d7679a-6128-5203-ba72-ad94d328f46b, identifier: HL58412
2026-03-30 05:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-30 05:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412
2026-03-30 05:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d7679a-6128-5203-ba72-ad94d328f46b with identifier: HL58412 to the API
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:59:46Z',
 'fuel_type': 'petrol',
 'id': '01d7679a-6128-5203-ba72-ad94d328f46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL58412',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 26297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-30 05:38:16 [auto1.de] INFO: Saving data for HL58412: {'auction_closing_time': 1774886386.0, 'created_time': 1773427811.198421, 'last_price_update_time': 1774849096.102887}
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL58412') HTTP/1.1" 204 0
2026-03-30 05:38:16 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-30 05:38:16 [auto1.de] INFO: Scrape type for AL26903: 2
2026-03-30 05:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-30 05:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db6e045d-d9f0-531b-ab7e-f61715115c8c with scrape type 2
2026-03-30 05:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db6e045d-d9f0-531b-ab7e-f61715115c8c with scrape type 2
2026-03-30 05:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db6e045d-d9f0-531b-ab7e-f61715115c8c, identifier: AL26903
2026-03-30 05:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-30 05:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903
2026-03-30 05:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db6e045d-d9f0-531b-ab7e-f61715115c8c with identifier: AL26903 to the API
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:21:16Z',
 'fuel_type': 'diesel',
 'id': 'db6e045d-d9f0-531b-ab7e-f61715115c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL26903',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Cherokee',
 'odometer': 92673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'Jeep Cherokee 2.2 M-Jet Overland 4WD',
 'transmission': 'automatic',
 'trim': 'Overland 4WD',
 'year': 2018}
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-30 05:38:16 [auto1.de] INFO: Saving data for AL26903: {'auction_closing_time': 1774884076.0, 'created_time': 1774675846.310387, 'last_price_update_time': 1774849096.582499}
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL26903') HTTP/1.1" 204 0
2026-03-30 05:38:16 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-30 05:38:16 [auto1.de] INFO: Scrape type for KU21621: 2
2026-03-30 05:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24a35f77-1f89-58e2-93b5-cc7e0f63296c with identifier: KU21621
2026-03-30 05:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24a35f77-1f89-58e2-93b5-cc7e0f63296c with scrape type 2
2026-03-30 05:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24a35f77-1f89-58e2-93b5-cc7e0f63296c with scrape type 2
2026-03-30 05:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24a35f77-1f89-58e2-93b5-cc7e0f63296c, identifier: KU21621
2026-03-30 05:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24a35f77-1f89-58e2-93b5-cc7e0f63296c with identifier: KU21621
2026-03-30 05:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24a35f77-1f89-58e2-93b5-cc7e0f63296c with identifier: KU21621
2026-03-30 05:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24a35f77-1f89-58e2-93b5-cc7e0f63296c with identifier: KU21621 to the API
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:50:19Z',
 'fuel_type': 'diesel',
 'id': '24a35f77-1f89-58e2-93b5-cc7e0f63296c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU21621',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 116582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-26',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six FWD',
 'transmission': 'automatic',
 'trim': 'Generation Six FWD',
 'year': 2022}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Saving data for KU21621: {'auction_closing_time': 1774885819.0, 'created_time': 1773685865.996472, 'last_price_update_time': 1774849097.039812}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU21621') HTTP/1.1" 204 0
2026-03-30 05:38:17 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-30 05:38:17 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Scrape type for AD35771: 2
2026-03-30 05:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc970dfa-b327-54f8-bb0a-a086539ed638 with identifier: AD35771
2026-03-30 05:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc970dfa-b327-54f8-bb0a-a086539ed638 with scrape type 2
2026-03-30 05:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc970dfa-b327-54f8-bb0a-a086539ed638 with scrape type 2
2026-03-30 05:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc970dfa-b327-54f8-bb0a-a086539ed638, identifier: AD35771
2026-03-30 05:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc970dfa-b327-54f8-bb0a-a086539ed638 with identifier: AD35771
2026-03-30 05:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc970dfa-b327-54f8-bb0a-a086539ed638 with identifier: AD35771
2026-03-30 05:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc970dfa-b327-54f8-bb0a-a086539ed638 with identifier: AD35771 to the API
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:54Z',
 'fuel_type': 'diesel',
 'id': 'fc970dfa-b327-54f8-bb0a-a086539ed638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD35771',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 182078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-21',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Saving data for AD35771: {'auction_closing_time': 1774883694.0, 'created_time': 1774638376.072019, 'last_price_update_time': 1774849097.450787}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD35771') HTTP/1.1" 204 0
2026-03-30 05:38:17 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-30 05:38:17 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-30 05:38:17 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Scrape type for ML19559: 2
2026-03-30 05:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f88630-1d46-5753-a01e-5a0c1d7c8155 with identifier: ML19559
2026-03-30 05:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f88630-1d46-5753-a01e-5a0c1d7c8155 with scrape type 2
2026-03-30 05:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f88630-1d46-5753-a01e-5a0c1d7c8155 with scrape type 2
2026-03-30 05:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f88630-1d46-5753-a01e-5a0c1d7c8155, identifier: ML19559
2026-03-30 05:38:17 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f88630-1d46-5753-a01e-5a0c1d7c8155 with identifier: ML19559
2026-03-30 05:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f88630-1d46-5753-a01e-5a0c1d7c8155 with identifier: ML19559
2026-03-30 05:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f88630-1d46-5753-a01e-5a0c1d7c8155 with identifier: ML19559 to the API
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:58:09Z',
 'fuel_type': 'petrol',
 'id': '76f88630-1d46-5753-a01e-5a0c1d7c8155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML19559',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 72783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-30 05:38:17 [auto1.de] INFO: Saving data for ML19559: {'auction_closing_time': 1774886289.0, 'created_time': 1773466770.022325, 'last_price_update_time': 1774849097.888076}
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML19559') HTTP/1.1" 204 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for PW70056: 2
2026-03-30 05:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5430595a-8497-5c22-ac38-e1d06a827e0e with identifier: PW70056
2026-03-30 05:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5430595a-8497-5c22-ac38-e1d06a827e0e with scrape type 2
2026-03-30 05:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5430595a-8497-5c22-ac38-e1d06a827e0e with scrape type 2
2026-03-30 05:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5430595a-8497-5c22-ac38-e1d06a827e0e, identifier: PW70056
2026-03-30 05:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5430595a-8497-5c22-ac38-e1d06a827e0e with identifier: PW70056
2026-03-30 05:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5430595a-8497-5c22-ac38-e1d06a827e0e with identifier: PW70056
2026-03-30 05:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5430595a-8497-5c22-ac38-e1d06a827e0e with identifier: PW70056 to the API
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:28Z',
 'fuel_type': 'petrol',
 'id': '5430595a-8497-5c22-ac38-e1d06a827e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW70056',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 117730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2011}
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Saving data for PW70056: {'auction_closing_time': 1774883848.0, 'created_time': 1774637132.271532, 'last_price_update_time': 1774849098.383496}
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW70056') HTTP/1.1" 204 0
2026-03-30 05:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for SM91292: 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for FZ71323: 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-30 05:38:18 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-30 05:38:18 [auto1.de] INFO: Scrape type for TT68659: 2
2026-03-30 05:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d297ee0b-764e-5ced-b3a1-01735c147631 with identifier: TT68659
2026-03-30 05:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d297ee0b-764e-5ced-b3a1-01735c147631 with scrape type 2
2026-03-30 05:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d297ee0b-764e-5ced-b3a1-01735c147631 with scrape type 2
2026-03-30 05:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d297ee0b-764e-5ced-b3a1-01735c147631, identifier: TT68659
2026-03-30 05:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d297ee0b-764e-5ced-b3a1-01735c147631 with identifier: TT68659
2026-03-30 05:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d297ee0b-764e-5ced-b3a1-01735c147631 with identifier: TT68659
2026-03-30 05:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d297ee0b-764e-5ced-b3a1-01735c147631 with identifier: TT68659 to the API
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:12Z',
 'fuel_type': 'diesel',
 'id': 'd297ee0b-764e-5ced-b3a1-01735c147631',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT68659',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 172067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Saving data for TT68659: {'auction_closing_time': 1774885452.0, 'created_time': 1774549877.678499, 'last_price_update_time': 1774849099.048742}
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT68659') HTTP/1.1" 204 0
2026-03-30 05:38:19 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Scrape type for EG87318: 2
2026-03-30 05:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with identifier: EG87318
2026-03-30 05:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with scrape type 2
2026-03-30 05:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with scrape type 2
2026-03-30 05:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fe5e555-de45-5d62-92e0-0ecabe3e1c63, identifier: EG87318
2026-03-30 05:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with identifier: EG87318
2026-03-30 05:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with identifier: EG87318
2026-03-30 05:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fe5e555-de45-5d62-92e0-0ecabe3e1c63 with identifier: EG87318 to the API
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': '0fe5e555-de45-5d62-92e0-0ecabe3e1c63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG87318',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 24604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2024}
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Saving data for EG87318: {'auction_closing_time': 1774885441.0, 'created_time': 1773428318.75807, 'last_price_update_time': 1774849099.559768}
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG87318') HTTP/1.1" 204 0
2026-03-30 05:38:19 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-30 05:38:19 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-30 05:38:19 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Scrape type for EG77695: 0
2026-03-30 05:38:19 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Scrape type for WC45623: 2
2026-03-30 05:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with identifier: WC45623
2026-03-30 05:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with scrape type 2
2026-03-30 05:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with scrape type 2
2026-03-30 05:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c87197-4fc9-57d5-9ba6-eec5371f00f5, identifier: WC45623
2026-03-30 05:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with identifier: WC45623
2026-03-30 05:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with identifier: WC45623
2026-03-30 05:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c87197-4fc9-57d5-9ba6-eec5371f00f5 with identifier: WC45623 to the API
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:44:35Z',
 'fuel_type': 'diesel',
 'id': 'e8c87197-4fc9-57d5-9ba6-eec5371f00f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC45623',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 171713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-18',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2020}
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-30 05:38:19 [auto1.de] INFO: Saving data for WC45623: {'auction_closing_time': 1774885475.0, 'created_time': 1774639395.573004, 'last_price_update_time': 1774849099.993135}
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC45623') HTTP/1.1" 204 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for HF48601: 2
2026-03-30 05:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bcfc57-79ec-586c-bd36-0353832be8b7 with identifier: HF48601
2026-03-30 05:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bcfc57-79ec-586c-bd36-0353832be8b7 with scrape type 2
2026-03-30 05:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46bcfc57-79ec-586c-bd36-0353832be8b7 with scrape type 2
2026-03-30 05:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46bcfc57-79ec-586c-bd36-0353832be8b7, identifier: HF48601
2026-03-30 05:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46bcfc57-79ec-586c-bd36-0353832be8b7 with identifier: HF48601
2026-03-30 05:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46bcfc57-79ec-586c-bd36-0353832be8b7 with identifier: HF48601
2026-03-30 05:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46bcfc57-79ec-586c-bd36-0353832be8b7 with identifier: HF48601 to the API
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:04:42Z',
 'fuel_type': 'petrol',
 'id': '46bcfc57-79ec-586c-bd36-0353832be8b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF48601',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 75663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2022}
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Saving data for HF48601: {'auction_closing_time': 1774883082.0, 'created_time': 1774639131.005287, 'last_price_update_time': 1774849100.409003}
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF48601') HTTP/1.1" 204 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for VH26233: 2
2026-03-30 05:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f8155e-0b35-5338-949d-9e1d91573c8c with identifier: VH26233
2026-03-30 05:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f8155e-0b35-5338-949d-9e1d91573c8c with scrape type 2
2026-03-30 05:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80f8155e-0b35-5338-949d-9e1d91573c8c with scrape type 2
2026-03-30 05:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80f8155e-0b35-5338-949d-9e1d91573c8c, identifier: VH26233
2026-03-30 05:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80f8155e-0b35-5338-949d-9e1d91573c8c with identifier: VH26233
2026-03-30 05:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80f8155e-0b35-5338-949d-9e1d91573c8c with identifier: VH26233
2026-03-30 05:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80f8155e-0b35-5338-949d-9e1d91573c8c with identifier: VH26233 to the API
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:30Z',
 'fuel_type': 'diesel',
 'id': '80f8155e-0b35-5338-949d-9e1d91573c8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH26233',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 111265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Saving data for VH26233: {'auction_closing_time': 1774883370.0, 'created_time': 1774637658.043617, 'last_price_update_time': 1774849100.852645}
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH26233') HTTP/1.1" 204 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-30 05:38:20 [auto1.de] INFO: Scrape type for WA19353: 0
2026-03-30 05:38:20 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-30 05:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:24 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for RR46383: 2
2026-03-30 05:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e9cc13-2046-5440-be95-eb8496c9e2ce with identifier: RR46383
2026-03-30 05:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2e9cc13-2046-5440-be95-eb8496c9e2ce with scrape type 2
2026-03-30 05:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2e9cc13-2046-5440-be95-eb8496c9e2ce with scrape type 2
2026-03-30 05:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2e9cc13-2046-5440-be95-eb8496c9e2ce, identifier: RR46383
2026-03-30 05:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2e9cc13-2046-5440-be95-eb8496c9e2ce with identifier: RR46383
2026-03-30 05:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2e9cc13-2046-5440-be95-eb8496c9e2ce with identifier: RR46383
2026-03-30 05:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2e9cc13-2046-5440-be95-eb8496c9e2ce with identifier: RR46383 to the API
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:34Z',
 'fuel_type': 'petrol',
 'id': 'a2e9cc13-2046-5440-be95-eb8496c9e2ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR46383',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 138422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-21',
 'seller_name': None,
 'title': 'Honda Civic 1.8 i-VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Saving data for RR46383: {'auction_closing_time': 1774883854.0, 'created_time': 1774638268.937815, 'last_price_update_time': 1774849104.752729}
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR46383') HTTP/1.1" 204 0
2026-03-30 05:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for BL86865: 0
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-30 05:38:24 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-30 05:38:24 [auto1.de] INFO: Scrape type for TR74961: 2
2026-03-30 05:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b78ac2c6-f782-5b3f-8f96-1f896a959255 with identifier: TR74961
2026-03-30 05:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b78ac2c6-f782-5b3f-8f96-1f896a959255 with scrape type 2
2026-03-30 05:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b78ac2c6-f782-5b3f-8f96-1f896a959255 with scrape type 2
2026-03-30 05:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b78ac2c6-f782-5b3f-8f96-1f896a959255, identifier: TR74961
2026-03-30 05:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b78ac2c6-f782-5b3f-8f96-1f896a959255 with identifier: TR74961
2026-03-30 05:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b78ac2c6-f782-5b3f-8f96-1f896a959255 with identifier: TR74961
2026-03-30 05:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b78ac2c6-f782-5b3f-8f96-1f896a959255 with identifier: TR74961 to the API
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:38:43Z',
 'fuel_type': 'petrol',
 'id': 'b78ac2c6-f782-5b3f-8f96-1f896a959255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR74961',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 223235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Saving data for TR74961: {'auction_closing_time': 1774885123.0, 'created_time': 1774639286.894676, 'last_price_update_time': 1774849105.197988}
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR74961') HTTP/1.1" 204 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for EN73396: 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for BR53906: 2
2026-03-30 05:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31a99fcb-4893-5893-b337-16d9dfeda876 with identifier: BR53906
2026-03-30 05:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31a99fcb-4893-5893-b337-16d9dfeda876 with scrape type 2
2026-03-30 05:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31a99fcb-4893-5893-b337-16d9dfeda876 with scrape type 2
2026-03-30 05:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31a99fcb-4893-5893-b337-16d9dfeda876, identifier: BR53906
2026-03-30 05:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31a99fcb-4893-5893-b337-16d9dfeda876 with identifier: BR53906
2026-03-30 05:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31a99fcb-4893-5893-b337-16d9dfeda876 with identifier: BR53906
2026-03-30 05:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31a99fcb-4893-5893-b337-16d9dfeda876 with identifier: BR53906 to the API
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:52:17Z',
 'fuel_type': 'diesel',
 'id': '31a99fcb-4893-5893-b337-16d9dfeda876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR53906',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 237366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-31',
 'seller_name': None,
 'title': 'Hyundai i20 1.1 CRDi Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2014}
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Saving data for BR53906: {'auction_closing_time': 1774885937.0, 'created_time': 1774637685.73004, 'last_price_update_time': 1774849105.823192}
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR53906') HTTP/1.1" 204 0
2026-03-30 05:38:25 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-30 05:38:25 [auto1.de] INFO: Scrape type for UP12343: 2
2026-03-30 05:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with identifier: UP12343
2026-03-30 05:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with scrape type 2
2026-03-30 05:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with scrape type 2
2026-03-30 05:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2705c0cf-d1b1-5058-93a1-c1a8eaed5235, identifier: UP12343
2026-03-30 05:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with identifier: UP12343
2026-03-30 05:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with identifier: UP12343
2026-03-30 05:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2705c0cf-d1b1-5058-93a1-c1a8eaed5235 with identifier: UP12343 to the API
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'diesel',
 'id': '2705c0cf-d1b1-5058-93a1-c1a8eaed5235',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP12343',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 270589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-17',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-30 05:38:26 [auto1.de] INFO: Saving data for UP12343: {'auction_closing_time': 1774883794.0, 'created_time': 1774637225.342991, 'last_price_update_time': 1774849106.326765}
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP12343') HTTP/1.1" 204 0
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-30 05:38:26 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-30 05:38:26 [auto1.de] INFO: Scrape type for FJ98191: 2
2026-03-30 05:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e892012-6657-5183-a4c4-5215cd91e9af with identifier: FJ98191
2026-03-30 05:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e892012-6657-5183-a4c4-5215cd91e9af with scrape type 2
2026-03-30 05:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e892012-6657-5183-a4c4-5215cd91e9af with scrape type 2
2026-03-30 05:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e892012-6657-5183-a4c4-5215cd91e9af, identifier: FJ98191
2026-03-30 05:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e892012-6657-5183-a4c4-5215cd91e9af with identifier: FJ98191
2026-03-30 05:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e892012-6657-5183-a4c4-5215cd91e9af with identifier: FJ98191
2026-03-30 05:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e892012-6657-5183-a4c4-5215cd91e9af with identifier: FJ98191 to the API
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:15:35Z',
 'fuel_type': 'petrol',
 'id': '3e892012-6657-5183-a4c4-5215cd91e9af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ98191',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 63682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-30 05:38:26 [auto1.de] INFO: Saving data for FJ98191: {'auction_closing_time': 1774883735.0, 'created_time': 1774638349.704579, 'last_price_update_time': 1774849106.732638}
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ98191') HTTP/1.1" 204 0
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-30 05:38:26 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-30 05:38:26 [auto1.de] INFO: Scrape type for MX02891: 2
2026-03-30 05:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932d0740-fde7-5d8a-8293-07c171bd6d6b with identifier: MX02891
2026-03-30 05:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932d0740-fde7-5d8a-8293-07c171bd6d6b with scrape type 2
2026-03-30 05:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932d0740-fde7-5d8a-8293-07c171bd6d6b with scrape type 2
2026-03-30 05:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 932d0740-fde7-5d8a-8293-07c171bd6d6b, identifier: MX02891
2026-03-30 05:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 932d0740-fde7-5d8a-8293-07c171bd6d6b with identifier: MX02891
2026-03-30 05:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 932d0740-fde7-5d8a-8293-07c171bd6d6b with identifier: MX02891
2026-03-30 05:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 932d0740-fde7-5d8a-8293-07c171bd6d6b with identifier: MX02891 to the API
2026-03-30 05:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:58Z',
 'fuel_type': 'petrol',
 'id': '932d0740-fde7-5d8a-8293-07c171bd6d6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX02891',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 150926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-16',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-30 05:38:27 [auto1.de] INFO: Saving data for MX02891: {'auction_closing_time': 1774883698.0, 'created_time': 1774637339.497596, 'last_price_update_time': 1774849107.154103}
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX02891') HTTP/1.1" 204 0
2026-03-30 05:38:27 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-30 05:38:27 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-30 05:38:27 [auto1.de] INFO: Scrape type for KB55712: 2
2026-03-30 05:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-30 05:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with scrape type 2
2026-03-30 05:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with scrape type 2
2026-03-30 05:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f82ae2ed-51d0-5ab3-bdb5-a89c368af251, identifier: KB55712
2026-03-30 05:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-30 05:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712
2026-03-30 05:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f82ae2ed-51d0-5ab3-bdb5-a89c368af251 with identifier: KB55712 to the API
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:10:53Z',
 'fuel_type': 'petrol',
 'id': 'f82ae2ed-51d0-5ab3-bdb5-a89c368af251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB55712',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 71330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-30 05:38:27 [auto1.de] INFO: Saving data for KB55712: {'auction_closing_time': 1774883453.0, 'created_time': 1773946253.72192, 'last_price_update_time': 1774849107.658375}
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB55712') HTTP/1.1" 204 0
2026-03-30 05:38:27 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 05:38:27 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-30 05:38:27 [auto1.de] INFO: Scrape type for JN55022: 0
2026-03-30 05:38:27 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-30 05:38:27 [auto1.de] INFO: Scrape type for SG10067: 2
2026-03-30 05:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with identifier: SG10067
2026-03-30 05:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with scrape type 2
2026-03-30 05:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with scrape type 2
2026-03-30 05:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3, identifier: SG10067
2026-03-30 05:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with identifier: SG10067
2026-03-30 05:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with identifier: SG10067
2026-03-30 05:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3 with identifier: SG10067 to the API
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:25:22Z',
 'fuel_type': 'diesel',
 'id': '7c69dde4-4ae4-53a8-a6fe-2f85e02b18c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG10067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 231781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-26',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-30 05:38:28 [auto1.de] INFO: Saving data for SG10067: {'auction_closing_time': 1774884322.0, 'created_time': 1774638316.35416, 'last_price_update_time': 1774849108.101555}
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG10067') HTTP/1.1" 204 0
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-30 05:38:28 [auto1.de] INFO: Scrape type for EM77424: 0
2026-03-30 05:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:28 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-30 05:38:28 [auto1.de] INFO: Scrape type for CV73879: 0
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-30 05:38:28 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-30 05:38:28 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-30 05:38:28 [auto1.de] INFO: Scrape type for CH69099: 2
2026-03-30 05:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff8b651-7bd8-5be6-8929-8c98fb3767ec with identifier: CH69099
2026-03-30 05:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aff8b651-7bd8-5be6-8929-8c98fb3767ec with scrape type 2
2026-03-30 05:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aff8b651-7bd8-5be6-8929-8c98fb3767ec with scrape type 2
2026-03-30 05:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aff8b651-7bd8-5be6-8929-8c98fb3767ec, identifier: CH69099
2026-03-30 05:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aff8b651-7bd8-5be6-8929-8c98fb3767ec with identifier: CH69099
2026-03-30 05:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aff8b651-7bd8-5be6-8929-8c98fb3767ec with identifier: CH69099
2026-03-30 05:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aff8b651-7bd8-5be6-8929-8c98fb3767ec with identifier: CH69099 to the API
2026-03-30 05:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:13:22Z',
 'fuel_type': 'petrol',
 'id': 'aff8b651-7bd8-5be6-8929-8c98fb3767ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH69099',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Sonata',
 'odometer': 124676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-13',
 'seller_name': None,
 'title': 'Hyundai Sonata 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2009}
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-30 05:38:29 [auto1.de] INFO: Saving data for CH69099: {'auction_closing_time': 1774883602.0, 'created_time': 1774549886.079703, 'last_price_update_time': 1774849109.119479}
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH69099') HTTP/1.1" 204 0
2026-03-30 05:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:29 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-30 05:38:29 [auto1.de] INFO: Scrape type for WL17910: 2
2026-03-30 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-30 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with scrape type 2
2026-03-30 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with scrape type 2
2026-03-30 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fb498fa-e45b-58f3-9031-e12b9313f8d8, identifier: WL17910
2026-03-30 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-30 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910
2026-03-30 05:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fb498fa-e45b-58f3-9031-e12b9313f8d8 with identifier: WL17910 to the API
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:03Z',
 'fuel_type': 'diesel',
 'id': '8fb498fa-e45b-58f3-9031-e12b9313f8d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL17910',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 248008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-31',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-30 05:38:29 [auto1.de] INFO: Saving data for WL17910: {'auction_closing_time': 1774883403.0, 'created_time': 1774675837.256262, 'last_price_update_time': 1774849109.639966}
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL17910') HTTP/1.1" 204 0
2026-03-30 05:38:29 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-30 05:38:29 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-30 05:38:29 [auto1.de] INFO: Scrape type for PM25348: 2
2026-03-30 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with identifier: PM25348
2026-03-30 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with scrape type 2
2026-03-30 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with scrape type 2
2026-03-30 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b53a21d7-3278-5fae-bf7b-fd8635a03ce6, identifier: PM25348
2026-03-30 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with identifier: PM25348
2026-03-30 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with identifier: PM25348
2026-03-30 05:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b53a21d7-3278-5fae-bf7b-fd8635a03ce6 with identifier: PM25348 to the API
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:39:38Z',
 'fuel_type': 'petrol',
 'id': 'b53a21d7-3278-5fae-bf7b-fd8635a03ce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM25348',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 143700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2014}
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Saving data for PM25348: {'auction_closing_time': 1774885178.0, 'created_time': 1774637724.899395, 'last_price_update_time': 1774849110.060594}
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM25348') HTTP/1.1" 204 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for HS03842: 2
2026-03-30 05:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with identifier: HS03842
2026-03-30 05:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with scrape type 2
2026-03-30 05:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with scrape type 2
2026-03-30 05:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c, identifier: HS03842
2026-03-30 05:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with identifier: HS03842
2026-03-30 05:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with identifier: HS03842
2026-03-30 05:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c with identifier: HS03842 to the API
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:09Z',
 'fuel_type': 'diesel',
 'id': '1b2f9c50-a3d5-51ac-a3dc-6ff97570f44c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS03842',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 202787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-09',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Saving data for HS03842: {'auction_closing_time': 1774886289.0, 'created_time': 1773427396.71254, 'last_price_update_time': 1774849110.482184}
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS03842') HTTP/1.1" 204 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for JS09258: 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 05:38:30 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-30 05:38:30 [auto1.de] INFO: Scrape type for CF09149: 2
2026-03-30 05:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with identifier: CF09149
2026-03-30 05:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with scrape type 2
2026-03-30 05:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with scrape type 2
2026-03-30 05:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3dd18c7-0d03-57e5-a09a-724c0a07a4c7, identifier: CF09149
2026-03-30 05:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with identifier: CF09149
2026-03-30 05:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with identifier: CF09149
2026-03-30 05:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3dd18c7-0d03-57e5-a09a-724c0a07a4c7 with identifier: CF09149 to the API
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'hybrid',
 'id': 'a3dd18c7-0d03-57e5-a09a-724c0a07a4c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF09149',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 67402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-17',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid N Line 4WD',
 'transmission': 'automatic',
 'trim': 'N Line 4WD',
 'year': 2021}
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Saving data for CF09149: {'auction_closing_time': 1774885529.0, 'created_time': 1774639350.189454, 'last_price_update_time': 1774849111.011245}
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF09149') HTTP/1.1" 204 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for VT43931: 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for VJ59637: 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Scrape type for UU53643: 2
2026-03-30 05:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efca7646-5c80-5871-b53e-bb44a5283688 with identifier: UU53643
2026-03-30 05:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efca7646-5c80-5871-b53e-bb44a5283688 with scrape type 2
2026-03-30 05:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efca7646-5c80-5871-b53e-bb44a5283688 with scrape type 2
2026-03-30 05:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efca7646-5c80-5871-b53e-bb44a5283688, identifier: UU53643
2026-03-30 05:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efca7646-5c80-5871-b53e-bb44a5283688 with identifier: UU53643
2026-03-30 05:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efca7646-5c80-5871-b53e-bb44a5283688 with identifier: UU53643
2026-03-30 05:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efca7646-5c80-5871-b53e-bb44a5283688 with identifier: UU53643 to the API
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'diesel',
 'id': 'efca7646-5c80-5871-b53e-bb44a5283688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU53643',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 93999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-12',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-30 05:38:31 [auto1.de] INFO: Saving data for UU53643: {'auction_closing_time': 1774885219.0, 'created_time': 1774031666.16278, 'last_price_update_time': 1774849111.870412}
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU53643') HTTP/1.1" 204 0
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-30 05:38:31 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-30 05:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:32 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-30 05:38:32 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-30 05:38:32 [auto1.de] INFO: Scrape type for MF02392: 2
2026-03-30 05:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3361efd-42c1-5ec7-b3eb-de202604b625 with identifier: MF02392
2026-03-30 05:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3361efd-42c1-5ec7-b3eb-de202604b625 with scrape type 2
2026-03-30 05:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3361efd-42c1-5ec7-b3eb-de202604b625 with scrape type 2
2026-03-30 05:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3361efd-42c1-5ec7-b3eb-de202604b625, identifier: MF02392
2026-03-30 05:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3361efd-42c1-5ec7-b3eb-de202604b625 with identifier: MF02392
2026-03-30 05:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3361efd-42c1-5ec7-b3eb-de202604b625 with identifier: MF02392
2026-03-30 05:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3361efd-42c1-5ec7-b3eb-de202604b625 with identifier: MF02392 to the API
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:39:11Z',
 'fuel_type': 'diesel',
 'id': 'a3361efd-42c1-5ec7-b3eb-de202604b625',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF02392',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 166779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-30 05:38:32 [auto1.de] INFO: Saving data for MF02392: {'auction_closing_time': 1774885151.0, 'created_time': 1773513468.271312, 'last_price_update_time': 1774849112.961672}
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF02392') HTTP/1.1" 204 0
2026-03-30 05:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-30 05:38:32 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-30 05:38:32 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-30 05:38:33 [auto1.de] INFO: Scrape type for NX28269: 2
2026-03-30 05:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95b7516-9f0d-5b50-891a-e2ac109c0aba with identifier: NX28269
2026-03-30 05:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95b7516-9f0d-5b50-891a-e2ac109c0aba with scrape type 2
2026-03-30 05:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95b7516-9f0d-5b50-891a-e2ac109c0aba with scrape type 2
2026-03-30 05:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e95b7516-9f0d-5b50-891a-e2ac109c0aba, identifier: NX28269
2026-03-30 05:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e95b7516-9f0d-5b50-891a-e2ac109c0aba with identifier: NX28269
2026-03-30 05:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e95b7516-9f0d-5b50-891a-e2ac109c0aba with identifier: NX28269
2026-03-30 05:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e95b7516-9f0d-5b50-891a-e2ac109c0aba with identifier: NX28269 to the API
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'petrol',
 'id': 'e95b7516-9f0d-5b50-891a-e2ac109c0aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX28269',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 100861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-30 05:38:33 [auto1.de] INFO: Saving data for NX28269: {'auction_closing_time': 1774884180.0, 'created_time': 1774637119.727449, 'last_price_update_time': 1774849113.566168}
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX28269') HTTP/1.1" 204 0
2026-03-30 05:38:33 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-30 05:38:33 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-30 05:38:33 [auto1.de] INFO: Scrape type for SZ56060: 2
2026-03-30 05:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac5bdec-9248-558e-ab85-416a1a603b0c with identifier: SZ56060
2026-03-30 05:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac5bdec-9248-558e-ab85-416a1a603b0c with scrape type 2
2026-03-30 05:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac5bdec-9248-558e-ab85-416a1a603b0c with scrape type 2
2026-03-30 05:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac5bdec-9248-558e-ab85-416a1a603b0c, identifier: SZ56060
2026-03-30 05:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac5bdec-9248-558e-ab85-416a1a603b0c with identifier: SZ56060
2026-03-30 05:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac5bdec-9248-558e-ab85-416a1a603b0c with identifier: SZ56060
2026-03-30 05:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac5bdec-9248-558e-ab85-416a1a603b0c with identifier: SZ56060 to the API
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:35:08Z',
 'fuel_type': 'petrol',
 'id': 'aac5bdec-9248-558e-ab85-416a1a603b0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ56060',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 48504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2021}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Saving data for SZ56060: {'auction_closing_time': 1774884908.0, 'created_time': 1773228572.07245, 'last_price_update_time': 1774849114.073505}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ56060') HTTP/1.1" 204 0
2026-03-30 05:38:34 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Scrape type for YD00860: 2
2026-03-30 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 203f92a8-aad2-538b-b84a-00b159d760f7 with identifier: YD00860
2026-03-30 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 203f92a8-aad2-538b-b84a-00b159d760f7 with scrape type 2
2026-03-30 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 203f92a8-aad2-538b-b84a-00b159d760f7 with scrape type 2
2026-03-30 05:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 203f92a8-aad2-538b-b84a-00b159d760f7, identifier: YD00860
2026-03-30 05:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 203f92a8-aad2-538b-b84a-00b159d760f7 with identifier: YD00860
2026-03-30 05:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 203f92a8-aad2-538b-b84a-00b159d760f7 with identifier: YD00860
2026-03-30 05:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 203f92a8-aad2-538b-b84a-00b159d760f7 with identifier: YD00860 to the API
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 530,
 'expiration_date': '2026-03-30T15:45:14Z',
 'fuel_type': 'petrol',
 'id': '203f92a8-aad2-538b-b84a-00b159d760f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD00860',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 31390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': None,
 'title': 'BMW 5er M550i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2019}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Saving data for YD00860: {'auction_closing_time': 1774885514.0, 'created_time': 1774349832.782211, 'last_price_update_time': 1774849114.5276}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD00860') HTTP/1.1" 204 0
2026-03-30 05:38:34 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Scrape type for DH44526: 2
2026-03-30 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with identifier: DH44526
2026-03-30 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with scrape type 2
2026-03-30 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with scrape type 2
2026-03-30 05:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d5c0d35-1b59-5adc-b823-c305fddf65a3, identifier: DH44526
2026-03-30 05:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with identifier: DH44526
2026-03-30 05:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with identifier: DH44526
2026-03-30 05:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d5c0d35-1b59-5adc-b823-c305fddf65a3 with identifier: DH44526 to the API
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:29:40Z',
 'fuel_type': 'hybrid',
 'id': '9d5c0d35-1b59-5adc-b823-c305fddf65a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH44526',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 44924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-30',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x4 La Première',
 'transmission': 'automatic',
 'trim': '4x4 La Première',
 'year': 2023}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Saving data for DH44526: {'auction_closing_time': 1774884580.0, 'created_time': 1773916237.148653, 'last_price_update_time': 1774849114.923871}
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH44526') HTTP/1.1" 204 0
2026-03-30 05:38:34 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-30 05:38:34 [auto1.de] INFO: Scrape type for PC60688: 2
2026-03-30 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-30 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item effb8867-b24a-51eb-ba75-c8f28700d8cd with scrape type 2
2026-03-30 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item effb8867-b24a-51eb-ba75-c8f28700d8cd with scrape type 2
2026-03-30 05:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: effb8867-b24a-51eb-ba75-c8f28700d8cd, identifier: PC60688
2026-03-30 05:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-30 05:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688
2026-03-30 05:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: effb8867-b24a-51eb-ba75-c8f28700d8cd with identifier: PC60688 to the API
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:24Z',
 'fuel_type': 'diesel',
 'id': 'effb8867-b24a-51eb-ba75-c8f28700d8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC60688',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 162569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2015}
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Saving data for PC60688: {'auction_closing_time': 1774884264.0, 'created_time': 1774550641.811672, 'last_price_update_time': 1774849115.322277}
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC60688') HTTP/1.1" 204 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for VL79730: 2
2026-03-30 05:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3602b202-9d04-5306-ad67-c90412535db4 with identifier: VL79730
2026-03-30 05:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3602b202-9d04-5306-ad67-c90412535db4 with scrape type 2
2026-03-30 05:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3602b202-9d04-5306-ad67-c90412535db4 with scrape type 2
2026-03-30 05:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3602b202-9d04-5306-ad67-c90412535db4, identifier: VL79730
2026-03-30 05:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3602b202-9d04-5306-ad67-c90412535db4 with identifier: VL79730
2026-03-30 05:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3602b202-9d04-5306-ad67-c90412535db4 with identifier: VL79730
2026-03-30 05:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3602b202-9d04-5306-ad67-c90412535db4 with identifier: VL79730 to the API
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:31Z',
 'fuel_type': 'diesel',
 'id': '3602b202-9d04-5306-ad67-c90412535db4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL79730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 217169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-10',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Saving data for VL79730: {'auction_closing_time': 1774885831.0, 'created_time': 1774637354.238028, 'last_price_update_time': 1774849115.808369}
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL79730') HTTP/1.1" 204 0
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-30 05:38:35 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-30 05:38:35 [auto1.de] INFO: Scrape type for JX01740: 0
2026-03-30 05:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:36 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Scrape type for CY50821: 2
2026-03-30 05:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 314f0685-633b-563b-b63d-7facce8f5e0b with identifier: CY50821
2026-03-30 05:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 314f0685-633b-563b-b63d-7facce8f5e0b with scrape type 2
2026-03-30 05:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 314f0685-633b-563b-b63d-7facce8f5e0b with scrape type 2
2026-03-30 05:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 314f0685-633b-563b-b63d-7facce8f5e0b, identifier: CY50821
2026-03-30 05:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 314f0685-633b-563b-b63d-7facce8f5e0b with identifier: CY50821
2026-03-30 05:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 314f0685-633b-563b-b63d-7facce8f5e0b with identifier: CY50821
2026-03-30 05:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 314f0685-633b-563b-b63d-7facce8f5e0b with identifier: CY50821 to the API
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:02Z',
 'fuel_type': 'petrol',
 'id': '314f0685-633b-563b-b63d-7facce8f5e0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY50821',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 112448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Saving data for CY50821: {'auction_closing_time': 1774884422.0, 'created_time': 1774034578.137455, 'last_price_update_time': 1774849116.454315}
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY50821') HTTP/1.1" 204 0
2026-03-30 05:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Scrape type for PH00076: 0
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Scrape type for AD50420: 0
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-30 05:38:36 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Scrape type for UH10138: 2
2026-03-30 05:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with identifier: UH10138
2026-03-30 05:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with scrape type 2
2026-03-30 05:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with scrape type 2
2026-03-30 05:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03bd8a1b-a505-5821-8bc4-eff9a0d29be4, identifier: UH10138
2026-03-30 05:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with identifier: UH10138
2026-03-30 05:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with identifier: UH10138
2026-03-30 05:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03bd8a1b-a505-5821-8bc4-eff9a0d29be4 with identifier: UH10138 to the API
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:20:10Z',
 'fuel_type': 'diesel',
 'id': '03bd8a1b-a505-5821-8bc4-eff9a0d29be4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH10138',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 140853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-26',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI Elegance M (L2)',
 'transmission': 'automatic',
 'trim': 'Elegance M (L2)',
 'year': 2020}
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-30 05:38:36 [auto1.de] INFO: Saving data for UH10138: {'auction_closing_time': 1774884010.0, 'created_time': 1774637273.941904, 'last_price_update_time': 1774849116.945133}
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH10138') HTTP/1.1" 204 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Scrape type for LN93862: 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Scrape type for ZF91540: 2
2026-03-30 05:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c144e66-2b65-5cda-85c8-e4bee719cdec with identifier: ZF91540
2026-03-30 05:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c144e66-2b65-5cda-85c8-e4bee719cdec with scrape type 2
2026-03-30 05:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c144e66-2b65-5cda-85c8-e4bee719cdec with scrape type 2
2026-03-30 05:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c144e66-2b65-5cda-85c8-e4bee719cdec, identifier: ZF91540
2026-03-30 05:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c144e66-2b65-5cda-85c8-e4bee719cdec with identifier: ZF91540
2026-03-30 05:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c144e66-2b65-5cda-85c8-e4bee719cdec with identifier: ZF91540
2026-03-30 05:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c144e66-2b65-5cda-85c8-e4bee719cdec with identifier: ZF91540 to the API
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:15:33Z',
 'fuel_type': 'diesel',
 'id': '5c144e66-2b65-5cda-85c8-e4bee719cdec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF91540',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 169309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-11',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Saving data for ZF91540: {'auction_closing_time': 1774883733.0, 'created_time': 1773917016.946344, 'last_price_update_time': 1774849117.523679}
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF91540') HTTP/1.1" 204 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Scrape type for ET59047: 2
2026-03-30 05:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc438293-7e6a-51d5-af69-14f14d5157c8 with identifier: ET59047
2026-03-30 05:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc438293-7e6a-51d5-af69-14f14d5157c8 with scrape type 2
2026-03-30 05:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc438293-7e6a-51d5-af69-14f14d5157c8 with scrape type 2
2026-03-30 05:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc438293-7e6a-51d5-af69-14f14d5157c8, identifier: ET59047
2026-03-30 05:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc438293-7e6a-51d5-af69-14f14d5157c8 with identifier: ET59047
2026-03-30 05:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc438293-7e6a-51d5-af69-14f14d5157c8 with identifier: ET59047
2026-03-30 05:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc438293-7e6a-51d5-af69-14f14d5157c8 with identifier: ET59047 to the API
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:47Z',
 'fuel_type': 'petrol',
 'id': 'bc438293-7e6a-51d5-af69-14f14d5157c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET59047',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 61784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-04',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2015}
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Saving data for ET59047: {'auction_closing_time': 1774884227.0, 'created_time': 1774637645.081941, 'last_price_update_time': 1774849117.932524}
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET59047') HTTP/1.1" 204 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-30 05:38:37 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-30 05:38:37 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-30 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-30 05:38:38 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Scrape type for BE16908: 2
2026-03-30 05:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-30 05:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02a173ab-74cf-5c13-94ff-1ae50b536a56 with scrape type 2
2026-03-30 05:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02a173ab-74cf-5c13-94ff-1ae50b536a56 with scrape type 2
2026-03-30 05:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02a173ab-74cf-5c13-94ff-1ae50b536a56, identifier: BE16908
2026-03-30 05:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-30 05:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908
2026-03-30 05:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02a173ab-74cf-5c13-94ff-1ae50b536a56 with identifier: BE16908 to the API
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:55:55Z',
 'fuel_type': 'diesel',
 'id': '02a173ab-74cf-5c13-94ff-1ae50b536a56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE16908',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 286202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-30 05:38:38 [auto1.de] INFO: Saving data for BE16908: {'auction_closing_time': 1774886155.0, 'created_time': 1774552599.759703, 'last_price_update_time': 1774849118.450104}
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE16908') HTTP/1.1" 204 0
2026-03-30 05:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:39 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:39 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-30 05:38:39 [auto1.de] INFO: Scrape type for AP07103: 0
2026-03-30 05:38:39 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-30 05:38:39 [auto1.de] INFO: Scrape type for JH64089: 0
2026-03-30 05:38:39 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-30 05:38:39 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-30 05:38:39 [auto1.de] INFO: Scrape type for HT61440: 2
2026-03-30 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1871cf0-0783-521e-9ccd-d2828794655a with identifier: HT61440
2026-03-30 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1871cf0-0783-521e-9ccd-d2828794655a with scrape type 2
2026-03-30 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1871cf0-0783-521e-9ccd-d2828794655a with scrape type 2
2026-03-30 05:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1871cf0-0783-521e-9ccd-d2828794655a, identifier: HT61440
2026-03-30 05:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1871cf0-0783-521e-9ccd-d2828794655a with identifier: HT61440
2026-03-30 05:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1871cf0-0783-521e-9ccd-d2828794655a with identifier: HT61440
2026-03-30 05:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1871cf0-0783-521e-9ccd-d2828794655a with identifier: HT61440 to the API
2026-03-30 05:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'diesel',
 'id': 'c1871cf0-0783-521e-9ccd-d2828794655a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT61440',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 25290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-30 05:38:40 [auto1.de] INFO: Saving data for HT61440: {'auction_closing_time': 1774882933.0, 'created_time': 1774639435.415679, 'last_price_update_time': 1774849120.287267}
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT61440') HTTP/1.1" 204 0
2026-03-30 05:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:40 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-30 05:38:40 [auto1.de] INFO: Scrape type for MX47183: 2
2026-03-30 05:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-30 05:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705f438c-3e95-5458-8353-b91f71d78d0e with scrape type 2
2026-03-30 05:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 705f438c-3e95-5458-8353-b91f71d78d0e with scrape type 2
2026-03-30 05:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 705f438c-3e95-5458-8353-b91f71d78d0e, identifier: MX47183
2026-03-30 05:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-30 05:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183
2026-03-30 05:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 705f438c-3e95-5458-8353-b91f71d78d0e with identifier: MX47183 to the API
2026-03-30 05:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'petrol',
 'id': '705f438c-3e95-5458-8353-b91f71d78d0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX47183',
 'listing': 'auction',
 'make': 'Borgward',
 'model': 'BX7',
 'odometer': 98951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-22',
 'seller_name': None,
 'title': 'Borgward BX7 2.0 TGDI TS Limited Edition',
 'transmission': 'automatic',
 'trim': 'TS Limited Edition',
 'year': 2018}
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-30 05:38:41 [auto1.de] INFO: Saving data for MX47183: {'auction_closing_time': 1774886316.0, 'created_time': 1774552333.440733, 'last_price_update_time': 1774849121.277427}
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX47183') HTTP/1.1" 204 0
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-30 05:38:41 [auto1.de] INFO: Scrape type for ZM37202: 2
2026-03-30 05:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-30 05:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa7c777-628e-5189-aa6a-3659d2046358 with scrape type 2
2026-03-30 05:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa7c777-628e-5189-aa6a-3659d2046358 with scrape type 2
2026-03-30 05:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa7c777-628e-5189-aa6a-3659d2046358, identifier: ZM37202
2026-03-30 05:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-30 05:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202
2026-03-30 05:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa7c777-628e-5189-aa6a-3659d2046358 with identifier: ZM37202 to the API
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:47:38Z',
 'fuel_type': 'diesel',
 'id': 'faa7c777-628e-5189-aa6a-3659d2046358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM37202',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 136723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-19',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-30 05:38:41 [auto1.de] INFO: Saving data for ZM37202: {'auction_closing_time': 1774885658.0, 'created_time': 1773226428.621854, 'last_price_update_time': 1774849121.665722}
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM37202') HTTP/1.1" 204 0
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-30 05:38:41 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-30 05:38:41 [auto1.de] INFO: Scrape type for PF23160: 2
2026-03-30 05:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b512c44-4a32-5197-985e-e85a90410720 with identifier: PF23160
2026-03-30 05:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b512c44-4a32-5197-985e-e85a90410720 with scrape type 2
2026-03-30 05:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b512c44-4a32-5197-985e-e85a90410720 with scrape type 2
2026-03-30 05:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b512c44-4a32-5197-985e-e85a90410720, identifier: PF23160
2026-03-30 05:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b512c44-4a32-5197-985e-e85a90410720 with identifier: PF23160
2026-03-30 05:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b512c44-4a32-5197-985e-e85a90410720 with identifier: PF23160
2026-03-30 05:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b512c44-4a32-5197-985e-e85a90410720 with identifier: PF23160 to the API
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:17:02Z',
 'fuel_type': 'diesel',
 'id': '0b512c44-4a32-5197-985e-e85a90410720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF23160',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 140761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'Jaguar XF 25d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2018}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Saving data for PF23160: {'auction_closing_time': 1774883822.0, 'created_time': 1774638418.082051, 'last_price_update_time': 1774849122.068264}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF23160') HTTP/1.1" 204 0
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Scrape type for CS78773: 0
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Scrape type for NY15812: 2
2026-03-30 05:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-30 05:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339f5dcd-75e7-52f2-a755-838c65e847cc with scrape type 2
2026-03-30 05:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339f5dcd-75e7-52f2-a755-838c65e847cc with scrape type 2
2026-03-30 05:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339f5dcd-75e7-52f2-a755-838c65e847cc, identifier: NY15812
2026-03-30 05:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-30 05:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812
2026-03-30 05:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339f5dcd-75e7-52f2-a755-838c65e847cc with identifier: NY15812 to the API
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:29:55Z',
 'fuel_type': 'petrol',
 'id': '339f5dcd-75e7-52f2-a755-838c65e847cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY15812',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 44054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-21',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Saving data for NY15812: {'auction_closing_time': 1774884595.0, 'created_time': 1774550659.691238, 'last_price_update_time': 1774849122.584061}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY15812') HTTP/1.1" 204 0
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Scrape type for UW48203: 2
2026-03-30 05:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-30 05:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d742f411-4b37-545c-b17c-109982748acd with scrape type 2
2026-03-30 05:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d742f411-4b37-545c-b17c-109982748acd with scrape type 2
2026-03-30 05:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d742f411-4b37-545c-b17c-109982748acd, identifier: UW48203
2026-03-30 05:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-30 05:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203
2026-03-30 05:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d742f411-4b37-545c-b17c-109982748acd with identifier: UW48203 to the API
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:14Z',
 'fuel_type': 'petrol',
 'id': 'd742f411-4b37-545c-b17c-109982748acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW48203',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 125084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-30 05:38:42 [auto1.de] INFO: Saving data for UW48203: {'auction_closing_time': 1774885694.0, 'created_time': 1774552638.662167, 'last_price_update_time': 1774849122.978872}
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW48203') HTTP/1.1" 204 0
2026-03-30 05:38:42 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for YC00325: 2
2026-03-30 05:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2876dbb-638a-5266-b041-e889fb388080 with identifier: YC00325
2026-03-30 05:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2876dbb-638a-5266-b041-e889fb388080 with scrape type 2
2026-03-30 05:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2876dbb-638a-5266-b041-e889fb388080 with scrape type 2
2026-03-30 05:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2876dbb-638a-5266-b041-e889fb388080, identifier: YC00325
2026-03-30 05:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2876dbb-638a-5266-b041-e889fb388080 with identifier: YC00325
2026-03-30 05:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2876dbb-638a-5266-b041-e889fb388080 with identifier: YC00325
2026-03-30 05:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2876dbb-638a-5266-b041-e889fb388080 with identifier: YC00325 to the API
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:48:39Z',
 'fuel_type': 'diesel',
 'id': 'e2876dbb-638a-5266-b041-e889fb388080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC00325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 155378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Saving data for YC00325: {'auction_closing_time': 1774885719.0, 'created_time': 1774638958.076992, 'last_price_update_time': 1774849123.387226}
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC00325') HTTP/1.1" 204 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for YJ27680: 0
2026-03-30 05:38:43 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Scrape type for TE58420: 2
2026-03-30 05:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-30 05:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0508104-735e-5d16-86d7-200a5cb885a1 with scrape type 2
2026-03-30 05:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0508104-735e-5d16-86d7-200a5cb885a1 with scrape type 2
2026-03-30 05:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0508104-735e-5d16-86d7-200a5cb885a1, identifier: TE58420
2026-03-30 05:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-30 05:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420
2026-03-30 05:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0508104-735e-5d16-86d7-200a5cb885a1 with identifier: TE58420 to the API
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:30:23Z',
 'fuel_type': 'diesel',
 'id': 'c0508104-735e-5d16-86d7-200a5cb885a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE58420',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 205823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 108 CDI Lang Worker',
 'transmission': 'manual',
 'trim': 'Lang Worker',
 'year': 2014}
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-30 05:38:43 [auto1.de] INFO: Saving data for TE58420: {'auction_closing_time': 1774884623.0, 'created_time': 1774552508.328908, 'last_price_update_time': 1774849123.886624}
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE58420') HTTP/1.1" 204 0
2026-03-30 05:38:44 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Scrape type for PG63962: 2
2026-03-30 05:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf108e1-57a8-5b08-819e-29611bcb2a8e with identifier: PG63962
2026-03-30 05:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf108e1-57a8-5b08-819e-29611bcb2a8e with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf108e1-57a8-5b08-819e-29611bcb2a8e with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf108e1-57a8-5b08-819e-29611bcb2a8e, identifier: PG63962
2026-03-30 05:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf108e1-57a8-5b08-819e-29611bcb2a8e with identifier: PG63962
2026-03-30 05:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf108e1-57a8-5b08-819e-29611bcb2a8e with identifier: PG63962
2026-03-30 05:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf108e1-57a8-5b08-819e-29611bcb2a8e with identifier: PG63962 to the API
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'petrol',
 'id': 'bdf108e1-57a8-5b08-819e-29611bcb2a8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG63962',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 60795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI R',
 'transmission': 'manual',
 'trim': 'R',
 'year': 2017}
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Saving data for PG63962: {'auction_closing_time': 1774886039.0, 'created_time': 1773946224.650426, 'last_price_update_time': 1774849124.39555}
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG63962') HTTP/1.1" 204 0
2026-03-30 05:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:44 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-30 05:38:44 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Scrape type for LU56386: 0
2026-03-30 05:38:44 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Scrape type for LC77518: 2
2026-03-30 05:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60a6541-8470-5aec-ad7a-1027dc2e207b with identifier: LC77518
2026-03-30 05:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60a6541-8470-5aec-ad7a-1027dc2e207b with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60a6541-8470-5aec-ad7a-1027dc2e207b with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b60a6541-8470-5aec-ad7a-1027dc2e207b, identifier: LC77518
2026-03-30 05:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b60a6541-8470-5aec-ad7a-1027dc2e207b with identifier: LC77518
2026-03-30 05:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b60a6541-8470-5aec-ad7a-1027dc2e207b with identifier: LC77518
2026-03-30 05:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b60a6541-8470-5aec-ad7a-1027dc2e207b with identifier: LC77518 to the API
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:01:40Z',
 'fuel_type': 'petrol',
 'id': 'b60a6541-8470-5aec-ad7a-1027dc2e207b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC77518',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Carisma',
 'odometer': 209285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-05-27',
 'seller_name': None,
 'title': 'Mitsubishi Carisma 1.8 GDI Avance 1800',
 'transmission': 'manual',
 'trim': 'Avance 1800',
 'year': 2001}
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Saving data for LC77518: {'auction_closing_time': 1774882900.0, 'created_time': 1774637222.590379, 'last_price_update_time': 1774849124.814171}
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC77518') HTTP/1.1" 204 0
2026-03-30 05:38:44 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-30 05:38:44 [auto1.de] INFO: Scrape type for WK06356: 2
2026-03-30 05:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-30 05:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with scrape type 2
2026-03-30 05:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084aae98-6b1f-5c3f-b581-97bbe5a20d92, identifier: WK06356
2026-03-30 05:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-30 05:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356
2026-03-30 05:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084aae98-6b1f-5c3f-b581-97bbe5a20d92 with identifier: WK06356 to the API
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:41Z',
 'fuel_type': 'petrol',
 'id': '084aae98-6b1f-5c3f-b581-97bbe5a20d92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK06356',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 32580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2023}
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Saving data for WK06356: {'auction_closing_time': 1774885001.0, 'created_time': 1773946466.818053, 'last_price_update_time': 1774849125.233641}
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK06356') HTTP/1.1" 204 0
2026-03-30 05:38:45 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Scrape type for DU69800: 2
2026-03-30 05:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-30 05:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f92a7736-d900-550e-972c-ab6033fe255c with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f92a7736-d900-550e-972c-ab6033fe255c with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f92a7736-d900-550e-972c-ab6033fe255c, identifier: DU69800
2026-03-30 05:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-30 05:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800
2026-03-30 05:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f92a7736-d900-550e-972c-ab6033fe255c with identifier: DU69800 to the API
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:30Z',
 'fuel_type': 'petrol',
 'id': 'f92a7736-d900-550e-972c-ab6033fe255c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU69800',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 143898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Saving data for DU69800: {'auction_closing_time': 1774884570.0, 'created_time': 1774550636.732956, 'last_price_update_time': 1774849125.649103}
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU69800') HTTP/1.1" 204 0
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Scrape type for AF84640: 0
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Scrape type for YG65181: 2
2026-03-30 05:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with identifier: YG65181
2026-03-30 05:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e2e4bca-6af4-57e3-b357-080fae5d9a43, identifier: YG65181
2026-03-30 05:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:45 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-30 05:38:45 [auto1.de] INFO: Scrape type for AH07700: 2
2026-03-30 05:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-30 05:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with scrape type 2
2026-03-30 05:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028, identifier: AH07700
2026-03-30 05:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with identifier: YG65181
2026-03-30 05:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with identifier: YG65181
2026-03-30 05:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e2e4bca-6af4-57e3-b357-080fae5d9a43 with identifier: YG65181 to the API
2026-03-30 05:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:09Z',
 'fuel_type': 'diesel',
 'id': '5e2e4bca-6af4-57e3-b357-080fae5d9a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG65181',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 107753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Saving data for YG65181: {'auction_closing_time': 1774882869.0, 'created_time': 1773830803.577467, 'last_price_update_time': 1774849126.188419}
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG65181') HTTP/1.1" 204 0
2026-03-30 05:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-30 05:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700
2026-03-30 05:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cd8eb1e-8d34-5dd9-b362-8d9232fa8028 with identifier: AH07700 to the API
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:21:06Z',
 'fuel_type': 'petrol',
 'id': '1cd8eb1e-8d34-5dd9-b362-8d9232fa8028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH07700',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 161201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2007}
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Saving data for AH07700: {'auction_closing_time': 1774884066.0, 'created_time': 1773945715.296506, 'last_price_update_time': 1774849126.576837}
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH07700') HTTP/1.1" 204 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for GP94559: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for GZ21000: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-30 05:38:46 [auto1.de] INFO: Scrape type for WP02035: 2
2026-03-30 05:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21043306-2e9a-5575-9a7d-d0ea32ada760 with identifier: WP02035
2026-03-30 05:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21043306-2e9a-5575-9a7d-d0ea32ada760 with scrape type 2
2026-03-30 05:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21043306-2e9a-5575-9a7d-d0ea32ada760 with scrape type 2
2026-03-30 05:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21043306-2e9a-5575-9a7d-d0ea32ada760, identifier: WP02035
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-30 05:38:46 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-30 05:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21043306-2e9a-5575-9a7d-d0ea32ada760 with identifier: WP02035
2026-03-30 05:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21043306-2e9a-5575-9a7d-d0ea32ada760 with identifier: WP02035
2026-03-30 05:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21043306-2e9a-5575-9a7d-d0ea32ada760 with identifier: WP02035 to the API
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:44Z',
 'fuel_type': 'petrol',
 'id': '21043306-2e9a-5575-9a7d-d0ea32ada760',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP02035',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 178073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Saving data for WP02035: {'auction_closing_time': 1774886264.0, 'created_time': 1774638585.519716, 'last_price_update_time': 1774849127.200388}
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP02035') HTTP/1.1" 204 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for AY81223: 2
2026-03-30 05:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79adba5f-ae78-557e-a91a-b7b2f325a5dd with identifier: AY81223
2026-03-30 05:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79adba5f-ae78-557e-a91a-b7b2f325a5dd with scrape type 2
2026-03-30 05:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79adba5f-ae78-557e-a91a-b7b2f325a5dd with scrape type 2
2026-03-30 05:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79adba5f-ae78-557e-a91a-b7b2f325a5dd, identifier: AY81223
2026-03-30 05:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79adba5f-ae78-557e-a91a-b7b2f325a5dd with identifier: AY81223
2026-03-30 05:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79adba5f-ae78-557e-a91a-b7b2f325a5dd with identifier: AY81223
2026-03-30 05:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79adba5f-ae78-557e-a91a-b7b2f325a5dd with identifier: AY81223 to the API
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:26:31Z',
 'fuel_type': 'petrol',
 'id': '79adba5f-ae78-557e-a91a-b7b2f325a5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY81223',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 45948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-31',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2023}
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Saving data for AY81223: {'auction_closing_time': 1774884391.0, 'created_time': 1774639265.307746, 'last_price_update_time': 1774849127.737252}
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY81223') HTTP/1.1" 204 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for FW15462: 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for DW82351: 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-30 05:38:47 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-30 05:38:47 [auto1.de] INFO: Scrape type for RW33443: 2
2026-03-30 05:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4a0f000-9514-5343-ae58-98018b9222cb with identifier: RW33443
2026-03-30 05:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4a0f000-9514-5343-ae58-98018b9222cb with scrape type 2
2026-03-30 05:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4a0f000-9514-5343-ae58-98018b9222cb with scrape type 2
2026-03-30 05:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4a0f000-9514-5343-ae58-98018b9222cb, identifier: RW33443
2026-03-30 05:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4a0f000-9514-5343-ae58-98018b9222cb with identifier: RW33443
2026-03-30 05:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4a0f000-9514-5343-ae58-98018b9222cb with identifier: RW33443
2026-03-30 05:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4a0f000-9514-5343-ae58-98018b9222cb with identifier: RW33443 to the API
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:53:46Z',
 'fuel_type': 'petrol',
 'id': 'e4a0f000-9514-5343-ae58-98018b9222cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW33443',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'PT Cruiser',
 'odometer': 106564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-30',
 'seller_name': None,
 'title': 'Chrysler PT Cruiser 2.4 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2004}
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-30 05:38:48 [auto1.de] INFO: Saving data for RW33443: {'auction_closing_time': 1774886026.0, 'created_time': 1774639385.796902, 'last_price_update_time': 1774849128.225991}
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW33443') HTTP/1.1" 204 0
2026-03-30 05:38:48 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-30 05:38:48 [auto1.de] INFO: Scrape type for ZK16564: 2
2026-03-30 05:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 655ba2cc-9438-5e17-abfd-b567e492866d with identifier: ZK16564
2026-03-30 05:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 655ba2cc-9438-5e17-abfd-b567e492866d with scrape type 2
2026-03-30 05:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 655ba2cc-9438-5e17-abfd-b567e492866d with scrape type 2
2026-03-30 05:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 655ba2cc-9438-5e17-abfd-b567e492866d, identifier: ZK16564
2026-03-30 05:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 655ba2cc-9438-5e17-abfd-b567e492866d with identifier: ZK16564
2026-03-30 05:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 655ba2cc-9438-5e17-abfd-b567e492866d with identifier: ZK16564
2026-03-30 05:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 655ba2cc-9438-5e17-abfd-b567e492866d with identifier: ZK16564 to the API
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:24Z',
 'fuel_type': 'diesel',
 'id': '655ba2cc-9438-5e17-abfd-b567e492866d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK16564',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 133035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-30 05:38:48 [auto1.de] INFO: Saving data for ZK16564: {'auction_closing_time': 1774885344.0, 'created_time': 1774638433.797198, 'last_price_update_time': 1774849128.706776}
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK16564') HTTP/1.1" 204 0
2026-03-30 05:38:48 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-30 05:38:48 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-30 05:38:48 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-30 05:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:49 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-30 05:38:49 [auto1.de] INFO: Scrape type for AK41294: 2
2026-03-30 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be74cbfa-779c-57b0-9c94-c8ea3ace144d with identifier: AK41294
2026-03-30 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be74cbfa-779c-57b0-9c94-c8ea3ace144d with scrape type 2
2026-03-30 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be74cbfa-779c-57b0-9c94-c8ea3ace144d with scrape type 2
2026-03-30 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be74cbfa-779c-57b0-9c94-c8ea3ace144d, identifier: AK41294
2026-03-30 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be74cbfa-779c-57b0-9c94-c8ea3ace144d with identifier: AK41294
2026-03-30 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be74cbfa-779c-57b0-9c94-c8ea3ace144d with identifier: AK41294
2026-03-30 05:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be74cbfa-779c-57b0-9c94-c8ea3ace144d with identifier: AK41294 to the API
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:00Z',
 'fuel_type': 'petrol',
 'id': 'be74cbfa-779c-57b0-9c94-c8ea3ace144d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK41294',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 6913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-30 05:38:49 [auto1.de] INFO: Saving data for AK41294: {'auction_closing_time': 1774884000.0, 'created_time': 1774639242.398686, 'last_price_update_time': 1774849129.787032}
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK41294') HTTP/1.1" 204 0
2026-03-30 05:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-30 05:38:49 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-30 05:38:49 [auto1.de] INFO: Scrape type for EJ25575: 2
2026-03-30 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e6d241-4c3b-5b17-a704-10ff90e4964c with identifier: EJ25575
2026-03-30 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e6d241-4c3b-5b17-a704-10ff90e4964c with scrape type 2
2026-03-30 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e6d241-4c3b-5b17-a704-10ff90e4964c with scrape type 2
2026-03-30 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73e6d241-4c3b-5b17-a704-10ff90e4964c, identifier: EJ25575
2026-03-30 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73e6d241-4c3b-5b17-a704-10ff90e4964c with identifier: EJ25575
2026-03-30 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73e6d241-4c3b-5b17-a704-10ff90e4964c with identifier: EJ25575
2026-03-30 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73e6d241-4c3b-5b17-a704-10ff90e4964c with identifier: EJ25575 to the API
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': '73e6d241-4c3b-5b17-a704-10ff90e4964c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ25575',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 30891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-19',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-30 05:38:50 [auto1.de] INFO: Saving data for EJ25575: {'auction_closing_time': 1774885633.0, 'created_time': 1774251067.962963, 'last_price_update_time': 1774849130.201144}
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ25575') HTTP/1.1" 204 0
2026-03-30 05:38:50 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-30 05:38:50 [auto1.de] INFO: Scrape type for XE86723: 2
2026-03-30 05:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d701168c-1160-517c-ba4d-fe75ffdf1739 with identifier: XE86723
2026-03-30 05:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d701168c-1160-517c-ba4d-fe75ffdf1739 with scrape type 2
2026-03-30 05:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d701168c-1160-517c-ba4d-fe75ffdf1739 with scrape type 2
2026-03-30 05:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d701168c-1160-517c-ba4d-fe75ffdf1739, identifier: XE86723
2026-03-30 05:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d701168c-1160-517c-ba4d-fe75ffdf1739 with identifier: XE86723
2026-03-30 05:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d701168c-1160-517c-ba4d-fe75ffdf1739 with identifier: XE86723
2026-03-30 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d701168c-1160-517c-ba4d-fe75ffdf1739 with identifier: XE86723 to the API
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:41Z',
 'fuel_type': 'diesel',
 'id': 'd701168c-1160-517c-ba4d-fe75ffdf1739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE86723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 50776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-30 05:38:50 [auto1.de] INFO: Saving data for XE86723: {'auction_closing_time': 1774884341.0, 'created_time': 1772544583.765126, 'last_price_update_time': 1774849130.621959}
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE86723') HTTP/1.1" 204 0
2026-03-30 05:38:50 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-30 05:38:50 [auto1.de] INFO: Scrape type for ZX31727: 2
2026-03-30 05:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with identifier: ZX31727
2026-03-30 05:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with scrape type 2
2026-03-30 05:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with scrape type 2
2026-03-30 05:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a06eb47-0e9f-5a5b-a027-ddab841d4b19, identifier: ZX31727
2026-03-30 05:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with identifier: ZX31727
2026-03-30 05:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with identifier: ZX31727
2026-03-30 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a06eb47-0e9f-5a5b-a027-ddab841d4b19 with identifier: ZX31727 to the API
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:41:00Z',
 'fuel_type': 'petrol',
 'id': '6a06eb47-0e9f-5a5b-a027-ddab841d4b19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX31727',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 125189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-23',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 5.7 V8 Limited HEMI',
 'transmission': 'automatic',
 'trim': 'Limited HEMI',
 'year': 2007}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Saving data for ZX31727: {'auction_closing_time': 1774885260.0, 'created_time': 1774637410.317362, 'last_price_update_time': 1774849131.011659}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX31727') HTTP/1.1" 204 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Scrape type for ZU04688: 2
2026-03-30 05:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-30 05:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with scrape type 2
2026-03-30 05:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with scrape type 2
2026-03-30 05:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73e34e44-5ce3-51f5-b98e-87d0f5614e77, identifier: ZU04688
2026-03-30 05:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-30 05:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688
2026-03-30 05:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73e34e44-5ce3-51f5-b98e-87d0f5614e77 with identifier: ZU04688 to the API
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:22Z',
 'fuel_type': 'diesel',
 'id': '73e34e44-5ce3-51f5-b98e-87d0f5614e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU04688',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 191725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-05',
 'seller_name': None,
 'title': 'Toyota Avensis 1.6 D-4D Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Saving data for ZU04688: {'auction_closing_time': 1774884262.0, 'created_time': 1774589439.68938, 'last_price_update_time': 1774849131.540908}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU04688') HTTP/1.1" 204 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Scrape type for JA06342: 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Scrape type for BF09730: 2
2026-03-30 05:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-30 05:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with scrape type 2
2026-03-30 05:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with scrape type 2
2026-03-30 05:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3525e7ab-71b1-54cc-a8da-9d891ca395b6, identifier: BF09730
2026-03-30 05:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-30 05:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730
2026-03-30 05:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3525e7ab-71b1-54cc-a8da-9d891ca395b6 with identifier: BF09730 to the API
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:25Z',
 'fuel_type': 'petrol',
 'id': '3525e7ab-71b1-54cc-a8da-9d891ca395b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF09730',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 114797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-12',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2010}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Saving data for BF09730: {'auction_closing_time': 1774883485.0, 'created_time': 1774553006.865527, 'last_price_update_time': 1774849131.95743}
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF09730') HTTP/1.1" 204 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-30 05:38:51 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 05:38:51 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-30 05:38:52 [auto1.de] INFO: Scrape type for NB64458: 2
2026-03-30 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f8c815c-8730-59b5-ba51-1a066b26ec4c with identifier: NB64458
2026-03-30 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f8c815c-8730-59b5-ba51-1a066b26ec4c with scrape type 2
2026-03-30 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f8c815c-8730-59b5-ba51-1a066b26ec4c with scrape type 2
2026-03-30 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f8c815c-8730-59b5-ba51-1a066b26ec4c, identifier: NB64458
2026-03-30 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f8c815c-8730-59b5-ba51-1a066b26ec4c with identifier: NB64458
2026-03-30 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f8c815c-8730-59b5-ba51-1a066b26ec4c with identifier: NB64458
2026-03-30 05:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f8c815c-8730-59b5-ba51-1a066b26ec4c with identifier: NB64458 to the API
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:22:47Z',
 'fuel_type': 'petrol',
 'id': '8f8c815c-8730-59b5-ba51-1a066b26ec4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB64458',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 167610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-04',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-30 05:38:52 [auto1.de] INFO: Saving data for NB64458: {'auction_closing_time': 1774884167.0, 'created_time': 1774550176.448849, 'last_price_update_time': 1774849132.400288}
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB64458') HTTP/1.1" 204 0
2026-03-30 05:38:52 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-30 05:38:52 [auto1.de] INFO: Scrape type for ZY22077: 2
2026-03-30 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-30 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with scrape type 2
2026-03-30 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with scrape type 2
2026-03-30 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db55283-45bc-58d5-8bb1-b7054fbb3b95, identifier: ZY22077
2026-03-30 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-30 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077
2026-03-30 05:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db55283-45bc-58d5-8bb1-b7054fbb3b95 with identifier: ZY22077 to the API
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:37Z',
 'fuel_type': 'diesel',
 'id': '3db55283-45bc-58d5-8bb1-b7054fbb3b95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY22077',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 98938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-30 05:38:52 [auto1.de] INFO: Saving data for ZY22077: {'auction_closing_time': 1774883257.0, 'created_time': 1774552473.35878, 'last_price_update_time': 1774849132.927384}
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY22077') HTTP/1.1" 204 0
2026-03-30 05:38:52 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-30 05:38:52 [auto1.de] INFO: Scrape type for PR91039: 2
2026-03-30 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab83443e-439c-549c-b832-83d5d6999594 with identifier: PR91039
2026-03-30 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab83443e-439c-549c-b832-83d5d6999594 with scrape type 2
2026-03-30 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab83443e-439c-549c-b832-83d5d6999594 with scrape type 2
2026-03-30 05:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab83443e-439c-549c-b832-83d5d6999594, identifier: PR91039
2026-03-30 05:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab83443e-439c-549c-b832-83d5d6999594 with identifier: PR91039
2026-03-30 05:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab83443e-439c-549c-b832-83d5d6999594 with identifier: PR91039
2026-03-30 05:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab83443e-439c-549c-b832-83d5d6999594 with identifier: PR91039 to the API
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:13:22Z',
 'fuel_type': 'petrol',
 'id': 'ab83443e-439c-549c-b832-83d5d6999594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR91039',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Saving data for PR91039: {'auction_closing_time': 1774883602.0, 'created_time': 1773945112.657009, 'last_price_update_time': 1774849133.34139}
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR91039') HTTP/1.1" 204 0
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Scrape type for BV47016: 0
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Scrape type for HT24863: 2
2026-03-30 05:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-30 05:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with scrape type 2
2026-03-30 05:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with scrape type 2
2026-03-30 05:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e, identifier: HT24863
2026-03-30 05:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-30 05:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863
2026-03-30 05:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c37f8d84-64f2-5833-b3d6-d6fa1f390e5e with identifier: HT24863 to the API
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:45:31Z',
 'fuel_type': 'diesel',
 'id': 'c37f8d84-64f2-5833-b3d6-d6fa1f390e5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT24863',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 170877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 300 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2020}
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Saving data for HT24863: {'auction_closing_time': 1774885531.0, 'created_time': 1774551667.868716, 'last_price_update_time': 1774849133.8893}
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT24863') HTTP/1.1" 204 0
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Scrape type for YC50370: 0
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-30 05:38:53 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-30 05:38:53 [auto1.de] INFO: Scrape type for RC04315: 2
2026-03-30 05:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d856a381-1878-5403-86d0-ffe864cff50c with identifier: RC04315
2026-03-30 05:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d856a381-1878-5403-86d0-ffe864cff50c with scrape type 2
2026-03-30 05:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d856a381-1878-5403-86d0-ffe864cff50c with scrape type 2
2026-03-30 05:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d856a381-1878-5403-86d0-ffe864cff50c, identifier: RC04315
2026-03-30 05:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d856a381-1878-5403-86d0-ffe864cff50c with identifier: RC04315
2026-03-30 05:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d856a381-1878-5403-86d0-ffe864cff50c with identifier: RC04315
2026-03-30 05:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d856a381-1878-5403-86d0-ffe864cff50c with identifier: RC04315 to the API
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:02:57Z',
 'fuel_type': 'diesel',
 'id': 'd856a381-1878-5403-86d0-ffe864cff50c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC04315',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 213904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Combi L1H1 2,7t',
 'year': 2017}
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-30 05:38:54 [auto1.de] INFO: Saving data for RC04315: {'auction_closing_time': 1774882977.0, 'created_time': 1774637961.80476, 'last_price_update_time': 1774849134.337652}
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC04315') HTTP/1.1" 204 0
2026-03-30 05:38:54 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-30 05:38:54 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-30 05:38:54 [auto1.de] INFO: Scrape type for XF59932: 0
2026-03-30 05:38:54 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-30 05:38:54 [auto1.de] INFO: Scrape type for XS21978: 2
2026-03-30 05:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-30 05:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293682dc-f0a0-5b2b-861e-ada7da75bb19 with scrape type 2
2026-03-30 05:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293682dc-f0a0-5b2b-861e-ada7da75bb19 with scrape type 2
2026-03-30 05:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293682dc-f0a0-5b2b-861e-ada7da75bb19, identifier: XS21978
2026-03-30 05:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-30 05:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978
2026-03-30 05:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293682dc-f0a0-5b2b-861e-ada7da75bb19 with identifier: XS21978 to the API
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:07:44Z',
 'fuel_type': 'diesel',
 'id': '293682dc-f0a0-5b2b-861e-ada7da75bb19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS21978',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 93979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-29',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.8 CRD Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2015}
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-30 05:38:54 [auto1.de] INFO: Saving data for XS21978: {'auction_closing_time': 1774883264.0, 'created_time': 1774589445.05818, 'last_price_update_time': 1774849134.866709}
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS21978') HTTP/1.1" 204 0
2026-03-30 05:38:54 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-30 05:38:54 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:54 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-30 05:38:54 [auto1.de] INFO: Scrape type for JG70236: 2
2026-03-30 05:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with identifier: JG70236
2026-03-30 05:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with scrape type 2
2026-03-30 05:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with scrape type 2
2026-03-30 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c3902c4-fbfd-5198-8864-387e8e2d84c0, identifier: JG70236
2026-03-30 05:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with identifier: JG70236
2026-03-30 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with identifier: JG70236
2026-03-30 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c3902c4-fbfd-5198-8864-387e8e2d84c0 with identifier: JG70236 to the API
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:48:27Z',
 'fuel_type': 'diesel',
 'id': '8c3902c4-fbfd-5198-8864-387e8e2d84c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG70236',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 70584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2020}
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Saving data for JG70236: {'auction_closing_time': 1774885707.0, 'created_time': 1773136443.03369, 'last_price_update_time': 1774849135.298246}
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG70236') HTTP/1.1" 204 0
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Scrape type for CP03676: 2
2026-03-30 05:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d097c936-1b37-50c4-b85a-af975969da19 with identifier: CP03676
2026-03-30 05:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d097c936-1b37-50c4-b85a-af975969da19 with scrape type 2
2026-03-30 05:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d097c936-1b37-50c4-b85a-af975969da19 with scrape type 2
2026-03-30 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d097c936-1b37-50c4-b85a-af975969da19, identifier: CP03676
2026-03-30 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d097c936-1b37-50c4-b85a-af975969da19 with identifier: CP03676
2026-03-30 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d097c936-1b37-50c4-b85a-af975969da19 with identifier: CP03676
2026-03-30 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d097c936-1b37-50c4-b85a-af975969da19 with identifier: CP03676 to the API
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:22Z',
 'fuel_type': 'petrol',
 'id': 'd097c936-1b37-50c4-b85a-af975969da19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP03676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 147179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Saving data for CP03676: {'auction_closing_time': 1774884262.0, 'created_time': 1774637128.455173, 'last_price_update_time': 1774849135.711604}
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP03676') HTTP/1.1" 204 0
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-30 05:38:55 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-30 05:38:55 [auto1.de] INFO: Scrape type for CY07264: 2
2026-03-30 05:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e041051-5fc7-5c63-905a-cb6e427e4e00 with identifier: CY07264
2026-03-30 05:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e041051-5fc7-5c63-905a-cb6e427e4e00 with scrape type 2
2026-03-30 05:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e041051-5fc7-5c63-905a-cb6e427e4e00 with scrape type 2
2026-03-30 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e041051-5fc7-5c63-905a-cb6e427e4e00, identifier: CY07264
2026-03-30 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e041051-5fc7-5c63-905a-cb6e427e4e00 with identifier: CY07264
2026-03-30 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e041051-5fc7-5c63-905a-cb6e427e4e00 with identifier: CY07264
2026-03-30 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e041051-5fc7-5c63-905a-cb6e427e4e00 with identifier: CY07264 to the API
2026-03-30 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:36Z',
 'fuel_type': 'petrol',
 'id': '6e041051-5fc7-5c63-905a-cb6e427e4e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY07264',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 63861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-17',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-30 05:38:56 [auto1.de] INFO: Saving data for CY07264: {'auction_closing_time': 1774885536.0, 'created_time': 1774638431.007576, 'last_price_update_time': 1774849136.134574}
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY07264') HTTP/1.1" 204 0
2026-03-30 05:38:56 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-30 05:38:56 [auto1.de] INFO: Scrape type for CM68518: 2
2026-03-30 05:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with identifier: CM68518
2026-03-30 05:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with scrape type 2
2026-03-30 05:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with scrape type 2
2026-03-30 05:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0927e50-780a-5bfc-9ba4-ab8ebe7951b7, identifier: CM68518
2026-03-30 05:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with identifier: CM68518
2026-03-30 05:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with identifier: CM68518
2026-03-30 05:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0927e50-780a-5bfc-9ba4-ab8ebe7951b7 with identifier: CM68518 to the API
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:20:53Z',
 'fuel_type': 'petrol',
 'id': 'b0927e50-780a-5bfc-9ba4-ab8ebe7951b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM68518',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 155804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-31',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI quattro Advanced',
 'transmission': 'manual',
 'trim': 'quattro Advanced',
 'year': 2011}
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-30 05:38:56 [auto1.de] INFO: Saving data for CM68518: {'auction_closing_time': 1774884053.0, 'created_time': 1774549858.413567, 'last_price_update_time': 1774849136.634331}
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM68518') HTTP/1.1" 204 0
2026-03-30 05:38:56 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-30 05:38:56 [auto1.de] INFO: Scrape type for FL51955: 2
2026-03-30 05:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a99c7f2d-f196-5008-93c5-a2f61752e6e9 with identifier: FL51955
2026-03-30 05:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a99c7f2d-f196-5008-93c5-a2f61752e6e9 with scrape type 2
2026-03-30 05:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a99c7f2d-f196-5008-93c5-a2f61752e6e9 with scrape type 2
2026-03-30 05:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a99c7f2d-f196-5008-93c5-a2f61752e6e9, identifier: FL51955
2026-03-30 05:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a99c7f2d-f196-5008-93c5-a2f61752e6e9 with identifier: FL51955
2026-03-30 05:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a99c7f2d-f196-5008-93c5-a2f61752e6e9 with identifier: FL51955
2026-03-30 05:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a99c7f2d-f196-5008-93c5-a2f61752e6e9 with identifier: FL51955 to the API
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': 'a99c7f2d-f196-5008-93c5-a2f61752e6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL51955',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 138525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-28',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Saving data for FL51955: {'auction_closing_time': 1774885412.0, 'created_time': 1774639151.505309, 'last_price_update_time': 1774849137.038108}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL51955') HTTP/1.1" 204 0
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Scrape type for ZJ17739: 0
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Scrape type for JD13909: 2
2026-03-30 05:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff793c95-8a13-5adc-94ef-c70d20050f0d with identifier: JD13909
2026-03-30 05:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff793c95-8a13-5adc-94ef-c70d20050f0d with scrape type 2
2026-03-30 05:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff793c95-8a13-5adc-94ef-c70d20050f0d with scrape type 2
2026-03-30 05:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff793c95-8a13-5adc-94ef-c70d20050f0d, identifier: JD13909
2026-03-30 05:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff793c95-8a13-5adc-94ef-c70d20050f0d with identifier: JD13909
2026-03-30 05:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff793c95-8a13-5adc-94ef-c70d20050f0d with identifier: JD13909
2026-03-30 05:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff793c95-8a13-5adc-94ef-c70d20050f0d with identifier: JD13909 to the API
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:26Z',
 'fuel_type': 'diesel',
 'id': 'ff793c95-8a13-5adc-94ef-c70d20050f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD13909',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 104520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun 4Motion',
 'transmission': 'manual',
 'trim': 'Trend & Fun 4Motion',
 'year': 2008}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Saving data for JD13909: {'auction_closing_time': 1774883066.0, 'created_time': 1774549843.791795, 'last_price_update_time': 1774849137.482267}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD13909') HTTP/1.1" 204 0
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-30 05:38:57 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Scrape type for KR15708: 2
2026-03-30 05:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with identifier: KR15708
2026-03-30 05:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with scrape type 2
2026-03-30 05:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with scrape type 2
2026-03-30 05:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1, identifier: KR15708
2026-03-30 05:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with identifier: KR15708
2026-03-30 05:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with identifier: KR15708
2026-03-30 05:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1 with identifier: KR15708 to the API
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': 'a4c1f3cc-0ace-5f31-8a7d-8f834b09a9d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR15708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 221892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2013}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-30 05:38:57 [auto1.de] INFO: Saving data for KR15708: {'auction_closing_time': 1774884897.0, 'created_time': 1774349954.033039, 'last_price_update_time': 1774849137.952419}
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR15708') HTTP/1.1" 204 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for DE35783: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for MS43037: 2
2026-03-30 05:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with identifier: MS43037
2026-03-30 05:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with scrape type 2
2026-03-30 05:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with scrape type 2
2026-03-30 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e72ce57-e7b4-5381-a611-c05bfa583ae3, identifier: MS43037
2026-03-30 05:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with identifier: MS43037
2026-03-30 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with identifier: MS43037
2026-03-30 05:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e72ce57-e7b4-5381-a611-c05bfa583ae3 with identifier: MS43037 to the API
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 551,
 'expiration_date': '2026-03-30T15:40:59Z',
 'fuel_type': 'petrol',
 'id': '5e72ce57-e7b4-5381-a611-c05bfa583ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS43037',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 99522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-31',
 'seller_name': None,
 'title': 'Jaguar F-Pace 5.0 V8 SVR AWD',
 'transmission': 'automatic',
 'trim': 'SVR AWD',
 'year': 2019}
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Saving data for MS43037: {'auction_closing_time': 1774885259.0, 'created_time': 1773428254.035754, 'last_price_update_time': 1774849138.548674}
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS43037') HTTP/1.1" 204 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-30 05:38:58 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Scrape type for HU97464: 2
2026-03-30 05:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-30 05:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccc47a3-c757-51e7-ad75-633138d47c0a with scrape type 2
2026-03-30 05:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccc47a3-c757-51e7-ad75-633138d47c0a with scrape type 2
2026-03-30 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ccc47a3-c757-51e7-ad75-633138d47c0a, identifier: HU97464
2026-03-30 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-30 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464
2026-03-30 05:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ccc47a3-c757-51e7-ad75-633138d47c0a with identifier: HU97464 to the API
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:30:51Z',
 'fuel_type': 'diesel',
 'id': '8ccc47a3-c757-51e7-ad75-633138d47c0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU97464',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 83995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-30 05:38:58 [auto1.de] INFO: Saving data for HU97464: {'auction_closing_time': 1774884651.0, 'created_time': 1774552658.897763, 'last_price_update_time': 1774849138.972097}
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU97464') HTTP/1.1" 204 0
2026-03-30 05:38:59 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6742 | hits on page: 40
2026-03-30 05:38:59 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-30 05:38:59 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-30 05:38:59 [auto1.de] INFO: Scrape type for EB16360: 2
2026-03-30 05:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 415ffc77-31e7-576a-97ce-05e6861f641a with identifier: EB16360
2026-03-30 05:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415ffc77-31e7-576a-97ce-05e6861f641a with scrape type 2
2026-03-30 05:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 415ffc77-31e7-576a-97ce-05e6861f641a with scrape type 2
2026-03-30 05:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 415ffc77-31e7-576a-97ce-05e6861f641a, identifier: EB16360
2026-03-30 05:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 415ffc77-31e7-576a-97ce-05e6861f641a with identifier: EB16360
2026-03-30 05:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 415ffc77-31e7-576a-97ce-05e6861f641a with identifier: EB16360
2026-03-30 05:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 415ffc77-31e7-576a-97ce-05e6861f641a with identifier: EB16360 to the API
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:10:54Z',
 'fuel_type': 'diesel',
 'id': '415ffc77-31e7-576a-97ce-05e6861f641a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB16360',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 489051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-26',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2011}
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-30 05:38:59 [auto1.de] INFO: Saving data for EB16360: {'auction_closing_time': 1774883454.0, 'created_time': 1774639044.300453, 'last_price_update_time': 1774849139.665994}
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB16360') HTTP/1.1" 204 0
2026-03-30 05:38:59 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-30 05:38:59 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-30 05:38:59 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-30 05:38:59 [auto1.de] INFO: Scrape type for MH67874: 2
2026-03-30 05:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with identifier: MH67874
2026-03-30 05:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with scrape type 2
2026-03-30 05:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with scrape type 2
2026-03-30 05:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69, identifier: MH67874
2026-03-30 05:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with identifier: MH67874
2026-03-30 05:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with identifier: MH67874
2026-03-30 05:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69 with identifier: MH67874 to the API
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:09:16Z',
 'fuel_type': 'petrol',
 'id': 'f12ce1a1-b6e8-59a8-b2d1-f9f101e2ac69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH67874',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 207108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Saving data for MH67874: {'auction_closing_time': 1774883356.0, 'created_time': 1774637136.498175, 'last_price_update_time': 1774849140.093952}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH67874') HTTP/1.1" 204 0
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Scrape type for SC05662: 2
2026-03-30 05:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-30 05:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with scrape type 2
2026-03-30 05:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with scrape type 2
2026-03-30 05:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4acfa056-75ed-58a7-bafb-9aa92b5167b4, identifier: SC05662
2026-03-30 05:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-30 05:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662
2026-03-30 05:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4acfa056-75ed-58a7-bafb-9aa92b5167b4 with identifier: SC05662 to the API
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 370,
 'expiration_date': '2026-03-30T15:03:06Z',
 'fuel_type': 'petrol',
 'id': '4acfa056-75ed-58a7-bafb-9aa92b5167b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC05662',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stinger',
 'odometer': 135262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Kia Stinger 3.3 V6 TGDI GT 4WD',
 'transmission': 'automatic',
 'trim': 'GT 4WD',
 'year': 2018}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Saving data for SC05662: {'auction_closing_time': 1774882986.0, 'created_time': 1774552923.738078, 'last_price_update_time': 1774849140.488935}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC05662') HTTP/1.1" 204 0
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Scrape type for FY91638: 2
2026-03-30 05:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1d363f-152e-53ec-b7dc-91f856452f93 with identifier: FY91638
2026-03-30 05:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1d363f-152e-53ec-b7dc-91f856452f93 with scrape type 2
2026-03-30 05:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a1d363f-152e-53ec-b7dc-91f856452f93 with scrape type 2
2026-03-30 05:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a1d363f-152e-53ec-b7dc-91f856452f93, identifier: FY91638
2026-03-30 05:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a1d363f-152e-53ec-b7dc-91f856452f93 with identifier: FY91638
2026-03-30 05:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a1d363f-152e-53ec-b7dc-91f856452f93 with identifier: FY91638
2026-03-30 05:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a1d363f-152e-53ec-b7dc-91f856452f93 with identifier: FY91638 to the API
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:42Z',
 'fuel_type': 'petrol',
 'id': '7a1d363f-152e-53ec-b7dc-91f856452f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY91638',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 120556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-06',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Saving data for FY91638: {'auction_closing_time': 1774884462.0, 'created_time': 1773917336.518811, 'last_price_update_time': 1774849140.87722}
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY91638') HTTP/1.1" 204 0
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-30 05:39:00 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-30 05:39:00 [auto1.de] INFO: Scrape type for LJ25483: 2
2026-03-30 05:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with identifier: LJ25483
2026-03-30 05:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with scrape type 2
2026-03-30 05:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with scrape type 2
2026-03-30 05:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b2e661-1b7f-5b4c-931d-0817c60beaf7, identifier: LJ25483
2026-03-30 05:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with identifier: LJ25483
2026-03-30 05:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with identifier: LJ25483
2026-03-30 05:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b2e661-1b7f-5b4c-931d-0817c60beaf7 with identifier: LJ25483 to the API
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:05:51Z',
 'fuel_type': 'diesel',
 'id': '10b2e661-1b7f-5b4c-931d-0817c60beaf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ25483',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 238963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-07',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Saving data for LJ25483: {'auction_closing_time': 1774883151.0, 'created_time': 1773306756.744123, 'last_price_update_time': 1774849141.336549}
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ25483') HTTP/1.1" 204 0
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Scrape type for RC37998: 0
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Scrape type for RV91936: 2
2026-03-30 05:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f6a080-8d78-5c7d-88f4-b8272172dae0 with identifier: RV91936
2026-03-30 05:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f6a080-8d78-5c7d-88f4-b8272172dae0 with scrape type 2
2026-03-30 05:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f6a080-8d78-5c7d-88f4-b8272172dae0 with scrape type 2
2026-03-30 05:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f6a080-8d78-5c7d-88f4-b8272172dae0, identifier: RV91936
2026-03-30 05:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f6a080-8d78-5c7d-88f4-b8272172dae0 with identifier: RV91936
2026-03-30 05:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f6a080-8d78-5c7d-88f4-b8272172dae0 with identifier: RV91936
2026-03-30 05:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f6a080-8d78-5c7d-88f4-b8272172dae0 with identifier: RV91936 to the API
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:45:29Z',
 'fuel_type': 'diesel',
 'id': 'd8f6a080-8d78-5c7d-88f4-b8272172dae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV91936',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 28859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-10',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi L1 Active',
 'transmission': 'automatic',
 'trim': 'L1 Active',
 'year': 2024}
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Saving data for RV91936: {'auction_closing_time': 1774885529.0, 'created_time': 1773305607.399799, 'last_price_update_time': 1774849141.862792}
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV91936') HTTP/1.1" 204 0
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-30 05:39:01 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-30 05:39:01 [auto1.de] INFO: Scrape type for FY17492: 2
2026-03-30 05:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e41d173c-9cdc-5975-97c4-217bf6499e78 with identifier: FY17492
2026-03-30 05:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e41d173c-9cdc-5975-97c4-217bf6499e78 with scrape type 2
2026-03-30 05:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e41d173c-9cdc-5975-97c4-217bf6499e78 with scrape type 2
2026-03-30 05:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e41d173c-9cdc-5975-97c4-217bf6499e78, identifier: FY17492
2026-03-30 05:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e41d173c-9cdc-5975-97c4-217bf6499e78 with identifier: FY17492
2026-03-30 05:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e41d173c-9cdc-5975-97c4-217bf6499e78 with identifier: FY17492
2026-03-30 05:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e41d173c-9cdc-5975-97c4-217bf6499e78 with identifier: FY17492 to the API
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:51Z',
 'fuel_type': 'petrol',
 'id': 'e41d173c-9cdc-5975-97c4-217bf6499e78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY17492',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 8812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2025}
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Saving data for FY17492: {'auction_closing_time': 1774883151.0, 'created_time': 1774637216.128743, 'last_price_update_time': 1774849142.271985}
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY17492') HTTP/1.1" 204 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for GU64592: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for RX78682: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for SV69696: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for UP35116: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-30 05:39:02 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-30 05:39:02 [auto1.de] INFO: Scrape type for GT54130: 2
2026-03-30 05:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4fb041b-4fcf-5ee6-9d23-158301fe510a with identifier: GT54130
2026-03-30 05:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4fb041b-4fcf-5ee6-9d23-158301fe510a with scrape type 2
2026-03-30 05:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4fb041b-4fcf-5ee6-9d23-158301fe510a with scrape type 2
2026-03-30 05:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4fb041b-4fcf-5ee6-9d23-158301fe510a, identifier: GT54130
2026-03-30 05:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4fb041b-4fcf-5ee6-9d23-158301fe510a with identifier: GT54130
2026-03-30 05:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4fb041b-4fcf-5ee6-9d23-158301fe510a with identifier: GT54130
2026-03-30 05:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4fb041b-4fcf-5ee6-9d23-158301fe510a with identifier: GT54130 to the API
2026-03-30 05:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:07:57Z',
 'fuel_type': 'petrol',
 'id': 'c4fb041b-4fcf-5ee6-9d23-158301fe510a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54130',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 109536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-30 05:39:03 [auto1.de] INFO: Saving data for GT54130: {'auction_closing_time': 1774883277.0, 'created_time': 1774349439.679489, 'last_price_update_time': 1774849143.78187}
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT54130') HTTP/1.1" 204 0
2026-03-30 05:39:03 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-30 05:39:03 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-30 05:39:03 [auto1.de] INFO: Scrape type for ZD80559: 2
2026-03-30 05:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f240ca-a581-549a-8e67-94969c8dbf57 with identifier: ZD80559
2026-03-30 05:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f240ca-a581-549a-8e67-94969c8dbf57 with scrape type 2
2026-03-30 05:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f240ca-a581-549a-8e67-94969c8dbf57 with scrape type 2
2026-03-30 05:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f240ca-a581-549a-8e67-94969c8dbf57, identifier: ZD80559
2026-03-30 05:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f240ca-a581-549a-8e67-94969c8dbf57 with identifier: ZD80559
2026-03-30 05:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f240ca-a581-549a-8e67-94969c8dbf57 with identifier: ZD80559
2026-03-30 05:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f240ca-a581-549a-8e67-94969c8dbf57 with identifier: ZD80559 to the API
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:50:29Z',
 'fuel_type': 'petrol',
 'id': 'd8f240ca-a581-549a-8e67-94969c8dbf57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD80559',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 153263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2015}
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Saving data for ZD80559: {'auction_closing_time': 1774885829.0, 'created_time': 1774639047.011439, 'last_price_update_time': 1774849144.264898}
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD80559') HTTP/1.1" 204 0
2026-03-30 05:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Scrape type for ZD36450: 2
2026-03-30 05:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with identifier: ZD36450
2026-03-30 05:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with scrape type 2
2026-03-30 05:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with scrape type 2
2026-03-30 05:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bd7f0ca-abd1-503b-ad0d-87182d19aea2, identifier: ZD36450
2026-03-30 05:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with identifier: ZD36450
2026-03-30 05:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with identifier: ZD36450
2026-03-30 05:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bd7f0ca-abd1-503b-ad0d-87182d19aea2 with identifier: ZD36450 to the API
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:23:01Z',
 'fuel_type': 'petrol',
 'id': '0bd7f0ca-abd1-503b-ad0d-87182d19aea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD36450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 245213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-04-21',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse 300 SE',
 'transmission': 'automatic',
 'trim': '',
 'year': 1992}
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Saving data for ZD36450: {'auction_closing_time': 1774884181.0, 'created_time': 1774638560.242672, 'last_price_update_time': 1774849144.681644}
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD36450') HTTP/1.1" 204 0
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Scrape type for DJ74321: 0
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-30 05:39:04 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-30 05:39:04 [auto1.de] INFO: Scrape type for PK18306: 2
2026-03-30 05:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-30 05:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47691d87-ba9c-5bec-b060-2a76eb1509ae with scrape type 2
2026-03-30 05:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47691d87-ba9c-5bec-b060-2a76eb1509ae with scrape type 2
2026-03-30 05:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47691d87-ba9c-5bec-b060-2a76eb1509ae, identifier: PK18306
2026-03-30 05:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-30 05:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306
2026-03-30 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47691d87-ba9c-5bec-b060-2a76eb1509ae with identifier: PK18306 to the API
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:37Z',
 'fuel_type': 'diesel',
 'id': '47691d87-ba9c-5bec-b060-2a76eb1509ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK18306',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 171524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2020}
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-30 05:39:05 [auto1.de] INFO: Saving data for PK18306: {'auction_closing_time': 1774885297.0, 'created_time': 1774552977.236686, 'last_price_update_time': 1774849145.255787}
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK18306') HTTP/1.1" 204 0
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-30 05:39:05 [auto1.de] INFO: Scrape type for YF32306: 0
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-30 05:39:05 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-30 05:39:05 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-30 05:39:05 [auto1.de] INFO: Scrape type for WH66881: 2
2026-03-30 05:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-30 05:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with scrape type 2
2026-03-30 05:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with scrape type 2
2026-03-30 05:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603, identifier: WH66881
2026-03-30 05:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-30 05:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881
2026-03-30 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41e51b4a-ef9c-5f3e-b1d8-e91ce3061603 with identifier: WH66881 to the API
2026-03-30 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:11Z',
 'fuel_type': 'diesel',
 'id': '41e51b4a-ef9c-5f3e-b1d8-e91ce3061603',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH66881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 169846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Saving data for WH66881: {'auction_closing_time': 1774885391.0, 'created_time': 1774552822.593512, 'last_price_update_time': 1774849146.259777}
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH66881') HTTP/1.1" 204 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for WJ18132: 2
2026-03-30 05:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-30 05:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0e326f-c07f-503c-b636-2248552ea00b with scrape type 2
2026-03-30 05:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0e326f-c07f-503c-b636-2248552ea00b with scrape type 2
2026-03-30 05:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0e326f-c07f-503c-b636-2248552ea00b, identifier: WJ18132
2026-03-30 05:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-30 05:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132
2026-03-30 05:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0e326f-c07f-503c-b636-2248552ea00b with identifier: WJ18132 to the API
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:43:22Z',
 'fuel_type': 'diesel',
 'id': '5f0e326f-c07f-503c-b636-2248552ea00b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ18132',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 88376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Saving data for WJ18132: {'auction_closing_time': 1774885402.0, 'created_time': 1774552103.400103, 'last_price_update_time': 1774849146.776264}
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ18132') HTTP/1.1" 204 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-30 05:39:06 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-30 05:39:06 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-30 05:39:06 [scrapy.extensions.logstats] INFO: Crawled 111 pages (at 12 pages/min), scraped 716 items (at 108 items/min)
2026-03-30 05:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:07 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:07 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-30 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-30 05:39:07 [auto1.de] INFO: Scrape type for XU09743: 2
2026-03-30 05:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d415f9bc-cbc5-5c86-8f1a-9002122923d1 with identifier: XU09743
2026-03-30 05:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d415f9bc-cbc5-5c86-8f1a-9002122923d1 with scrape type 2
2026-03-30 05:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d415f9bc-cbc5-5c86-8f1a-9002122923d1 with scrape type 2
2026-03-30 05:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d415f9bc-cbc5-5c86-8f1a-9002122923d1, identifier: XU09743
2026-03-30 05:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d415f9bc-cbc5-5c86-8f1a-9002122923d1 with identifier: XU09743
2026-03-30 05:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d415f9bc-cbc5-5c86-8f1a-9002122923d1 with identifier: XU09743
2026-03-30 05:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d415f9bc-cbc5-5c86-8f1a-9002122923d1 with identifier: XU09743 to the API
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'diesel',
 'id': 'd415f9bc-cbc5-5c86-8f1a-9002122923d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU09743',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 114630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-15',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Saving data for XU09743: {'auction_closing_time': 1774885551.0, 'created_time': 1774639430.181577, 'last_price_update_time': 1774849148.210227}
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU09743') HTTP/1.1" 204 0
2026-03-30 05:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Scrape type for KT07926: 0
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Scrape type for SS68419: 2
2026-03-30 05:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-30 05:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8019f072-9d8b-5d9e-ad0f-ee821a136852 with scrape type 2
2026-03-30 05:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8019f072-9d8b-5d9e-ad0f-ee821a136852 with scrape type 2
2026-03-30 05:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8019f072-9d8b-5d9e-ad0f-ee821a136852, identifier: SS68419
2026-03-30 05:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-30 05:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419
2026-03-30 05:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8019f072-9d8b-5d9e-ad0f-ee821a136852 with identifier: SS68419 to the API
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-30T15:10:14Z',
 'fuel_type': 'petrol',
 'id': '8019f072-9d8b-5d9e-ad0f-ee821a136852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS68419',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Energy Crossborder',
 'transmission': 'automatic',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Saving data for SS68419: {'auction_closing_time': 1774883414.0, 'created_time': 1774552450.315299, 'last_price_update_time': 1774849148.774673}
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS68419') HTTP/1.1" 204 0
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-30 05:39:08 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-30 05:39:08 [auto1.de] INFO: Scrape type for JG67628: 2
2026-03-30 05:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with identifier: JG67628
2026-03-30 05:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with scrape type 2
2026-03-30 05:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with scrape type 2
2026-03-30 05:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e, identifier: JG67628
2026-03-30 05:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with identifier: JG67628
2026-03-30 05:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with identifier: JG67628
2026-03-30 05:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c3a92e3-3172-52c2-8d80-fe808d3bbd4e with identifier: JG67628 to the API
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:31:05Z',
 'fuel_type': 'diesel',
 'id': '8c3a92e3-3172-52c2-8d80-fe808d3bbd4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG67628',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 166593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2017}
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-30 05:39:09 [auto1.de] INFO: Saving data for JG67628: {'auction_closing_time': 1774884665.0, 'created_time': 1774637951.388536, 'last_price_update_time': 1774849149.221127}
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG67628') HTTP/1.1" 204 0
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-30 05:39:09 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-30 05:39:09 [auto1.de] INFO: Scrape type for TD91904: 2
2026-03-30 05:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31b09cfc-01cb-5f03-a368-fa842b4ba839 with identifier: TD91904
2026-03-30 05:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31b09cfc-01cb-5f03-a368-fa842b4ba839 with scrape type 2
2026-03-30 05:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31b09cfc-01cb-5f03-a368-fa842b4ba839 with scrape type 2
2026-03-30 05:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31b09cfc-01cb-5f03-a368-fa842b4ba839, identifier: TD91904
2026-03-30 05:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31b09cfc-01cb-5f03-a368-fa842b4ba839 with identifier: TD91904
2026-03-30 05:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31b09cfc-01cb-5f03-a368-fa842b4ba839 with identifier: TD91904
2026-03-30 05:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31b09cfc-01cb-5f03-a368-fa842b4ba839 with identifier: TD91904 to the API
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'diesel',
 'id': '31b09cfc-01cb-5f03-a368-fa842b4ba839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD91904',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 132984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-30 05:39:09 [auto1.de] INFO: Saving data for TD91904: {'auction_closing_time': 1774883596.0, 'created_time': 1774637258.221772, 'last_price_update_time': 1774849149.644016}
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD91904') HTTP/1.1" 204 0
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-30 05:39:09 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-30 05:39:09 [auto1.de] INFO: Scrape type for WZ46352: 2
2026-03-30 05:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with identifier: WZ46352
2026-03-30 05:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with scrape type 2
2026-03-30 05:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with scrape type 2
2026-03-30 05:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88d7dd55-aab0-5dd4-9c34-7a5b773b1805, identifier: WZ46352
2026-03-30 05:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with identifier: WZ46352
2026-03-30 05:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with identifier: WZ46352
2026-03-30 05:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88d7dd55-aab0-5dd4-9c34-7a5b773b1805 with identifier: WZ46352 to the API
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:49:57Z',
 'fuel_type': 'petrol',
 'id': '88d7dd55-aab0-5dd4-9c34-7a5b773b1805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ46352',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-25',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Saving data for WZ46352: {'auction_closing_time': 1774885797.0, 'created_time': 1774637088.341301, 'last_price_update_time': 1774849150.052506}
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ46352') HTTP/1.1" 204 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for FP97739: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for HG82543: 2
2026-03-30 05:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea319422-6111-5617-96bd-f59f91f5200f with identifier: HG82543
2026-03-30 05:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea319422-6111-5617-96bd-f59f91f5200f with scrape type 2
2026-03-30 05:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea319422-6111-5617-96bd-f59f91f5200f with scrape type 2
2026-03-30 05:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea319422-6111-5617-96bd-f59f91f5200f, identifier: HG82543
2026-03-30 05:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea319422-6111-5617-96bd-f59f91f5200f with identifier: HG82543
2026-03-30 05:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea319422-6111-5617-96bd-f59f91f5200f with identifier: HG82543
2026-03-30 05:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea319422-6111-5617-96bd-f59f91f5200f with identifier: HG82543 to the API
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:05:45Z',
 'fuel_type': 'petrol',
 'id': 'ea319422-6111-5617-96bd-f59f91f5200f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG82543',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 186396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-13',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Saving data for HG82543: {'auction_closing_time': 1774883145.0, 'created_time': 1774032113.927305, 'last_price_update_time': 1774849150.619515}
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG82543') HTTP/1.1" 204 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for KY48204: 0
2026-03-30 05:39:10 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-30 05:39:10 [auto1.de] INFO: Scrape type for GG07111: 2
2026-03-30 05:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-30 05:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d2e1449-8fef-5224-b434-cd4c3f222b6a with scrape type 2
2026-03-30 05:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d2e1449-8fef-5224-b434-cd4c3f222b6a with scrape type 2
2026-03-30 05:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d2e1449-8fef-5224-b434-cd4c3f222b6a, identifier: GG07111
2026-03-30 05:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-30 05:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111
2026-03-30 05:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d2e1449-8fef-5224-b434-cd4c3f222b6a with identifier: GG07111 to the API
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:25:37Z',
 'fuel_type': 'petrol',
 'id': '2d2e1449-8fef-5224-b434-cd4c3f222b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG07111',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 118466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-26',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-30 05:39:11 [auto1.de] INFO: Saving data for GG07111: {'auction_closing_time': 1774884337.0, 'created_time': 1774550198.958044, 'last_price_update_time': 1774849151.055509}
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG07111') HTTP/1.1" 204 0
2026-03-30 05:39:11 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-30 05:39:11 [auto1.de] INFO: Scrape type for HL48230: 2
2026-03-30 05:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b26096-f2b1-5b17-902e-575daa8e2de1 with identifier: HL48230
2026-03-30 05:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b26096-f2b1-5b17-902e-575daa8e2de1 with scrape type 2
2026-03-30 05:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b26096-f2b1-5b17-902e-575daa8e2de1 with scrape type 2
2026-03-30 05:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56b26096-f2b1-5b17-902e-575daa8e2de1, identifier: HL48230
2026-03-30 05:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56b26096-f2b1-5b17-902e-575daa8e2de1 with identifier: HL48230
2026-03-30 05:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56b26096-f2b1-5b17-902e-575daa8e2de1 with identifier: HL48230
2026-03-30 05:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56b26096-f2b1-5b17-902e-575daa8e2de1 with identifier: HL48230 to the API
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:14:34Z',
 'fuel_type': 'petrol',
 'id': '56b26096-f2b1-5b17-902e-575daa8e2de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL48230',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 81290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-12',
 'seller_name': None,
 'title': 'Dacia Sandero 1.6 Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2010}
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-30 05:39:11 [auto1.de] INFO: Saving data for HL48230: {'auction_closing_time': 1774883674.0, 'created_time': 1774637781.57625, 'last_price_update_time': 1774849151.61282}
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL48230') HTTP/1.1" 204 0
2026-03-30 05:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:11 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-30 05:39:11 [auto1.de] INFO: Scrape type for UY59901: 2
2026-03-30 05:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with identifier: UY59901
2026-03-30 05:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with scrape type 2
2026-03-30 05:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with scrape type 2
2026-03-30 05:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8784d6b4-3def-5287-8a93-7a0ca4e5bf77, identifier: UY59901
2026-03-30 05:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with identifier: UY59901
2026-03-30 05:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with identifier: UY59901
2026-03-30 05:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8784d6b4-3def-5287-8a93-7a0ca4e5bf77 with identifier: UY59901 to the API
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:54:39Z',
 'fuel_type': 'diesel',
 'id': '8784d6b4-3def-5287-8a93-7a0ca4e5bf77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY59901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 229859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Saving data for UY59901: {'auction_closing_time': 1774886079.0, 'created_time': 1774638404.012319, 'last_price_update_time': 1774849152.02073}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY59901') HTTP/1.1" 204 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for PS42902: 2
2026-03-30 05:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b348ec53-6641-5d74-8efe-5b287a3f72b1 with identifier: PS42902
2026-03-30 05:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b348ec53-6641-5d74-8efe-5b287a3f72b1 with scrape type 2
2026-03-30 05:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b348ec53-6641-5d74-8efe-5b287a3f72b1 with scrape type 2
2026-03-30 05:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b348ec53-6641-5d74-8efe-5b287a3f72b1, identifier: PS42902
2026-03-30 05:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b348ec53-6641-5d74-8efe-5b287a3f72b1 with identifier: PS42902
2026-03-30 05:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b348ec53-6641-5d74-8efe-5b287a3f72b1 with identifier: PS42902
2026-03-30 05:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b348ec53-6641-5d74-8efe-5b287a3f72b1 with identifier: PS42902 to the API
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'diesel',
 'id': 'b348ec53-6641-5d74-8efe-5b287a3f72b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS42902',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 19622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-30',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Saving data for PS42902: {'auction_closing_time': 1774885311.0, 'created_time': 1774549999.207395, 'last_price_update_time': 1774849152.43399}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS42902') HTTP/1.1" 204 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for TJ52471: 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for BV96040: 2
2026-03-30 05:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-30 05:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with scrape type 2
2026-03-30 05:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with scrape type 2
2026-03-30 05:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5, identifier: BV96040
2026-03-30 05:39:12 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-30 05:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040
2026-03-30 05:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5eb7ac6-9dda-53b0-9a08-d670731fe7e5 with identifier: BV96040 to the API
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:05Z',
 'fuel_type': 'petrol',
 'id': 'c5eb7ac6-9dda-53b0-9a08-d670731fe7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV96040',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 21326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-25',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Saving data for BV96040: {'auction_closing_time': 1774885385.0, 'created_time': 1774551058.868757, 'last_price_update_time': 1774849152.915423}
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV96040') HTTP/1.1" 204 0
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 05:39:12 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-30 05:39:12 [auto1.de] INFO: Scrape type for AU38078: 2
2026-03-30 05:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-30 05:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 711cf0ed-d644-5948-993b-b9e325609017 with scrape type 2
2026-03-30 05:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 711cf0ed-d644-5948-993b-b9e325609017 with scrape type 2
2026-03-30 05:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 711cf0ed-d644-5948-993b-b9e325609017, identifier: AU38078
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for MF11383: 0
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for RC52895: 2
2026-03-30 05:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 528deff3-6e74-5cd7-a59e-afef20f82d6d with identifier: RC52895
2026-03-30 05:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 528deff3-6e74-5cd7-a59e-afef20f82d6d with scrape type 2
2026-03-30 05:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 528deff3-6e74-5cd7-a59e-afef20f82d6d with scrape type 2
2026-03-30 05:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 528deff3-6e74-5cd7-a59e-afef20f82d6d, identifier: RC52895
2026-03-30 05:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-30 05:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078
2026-03-30 05:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 711cf0ed-d644-5948-993b-b9e325609017 with identifier: AU38078 to the API
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:27:30Z',
 'fuel_type': 'petrol',
 'id': '711cf0ed-d644-5948-993b-b9e325609017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU38078',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 75689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-03',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Saving data for AU38078: {'auction_closing_time': 1774884450.0, 'created_time': 1774552888.665271, 'last_price_update_time': 1774849153.481482}
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU38078') HTTP/1.1" 204 0
2026-03-30 05:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 528deff3-6e74-5cd7-a59e-afef20f82d6d with identifier: RC52895
2026-03-30 05:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 528deff3-6e74-5cd7-a59e-afef20f82d6d with identifier: RC52895
2026-03-30 05:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 528deff3-6e74-5cd7-a59e-afef20f82d6d with identifier: RC52895 to the API
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:02:01Z',
 'fuel_type': 'petrol',
 'id': '528deff3-6e74-5cd7-a59e-afef20f82d6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC52895',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 106702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-14',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Saving data for RC52895: {'auction_closing_time': 1774882921.0, 'created_time': 1773916569.468512, 'last_price_update_time': 1774849153.878822}
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC52895') HTTP/1.1" 204 0
2026-03-30 05:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-30 05:39:13 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-30 05:39:13 [auto1.de] INFO: Scrape type for LT46739: 2
2026-03-30 05:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with identifier: LT46739
2026-03-30 05:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with scrape type 2
2026-03-30 05:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with scrape type 2
2026-03-30 05:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37bddb2f-8e4a-5c36-818a-24db13cf4d16, identifier: LT46739
2026-03-30 05:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with identifier: LT46739
2026-03-30 05:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with identifier: LT46739
2026-03-30 05:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37bddb2f-8e4a-5c36-818a-24db13cf4d16 with identifier: LT46739 to the API
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:44:00Z',
 'fuel_type': 'petrol',
 'id': '37bddb2f-8e4a-5c36-818a-24db13cf4d16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT46739',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 83889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.5 TSI ACT Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-30 05:39:14 [auto1.de] INFO: Saving data for LT46739: {'auction_closing_time': 1774885440.0, 'created_time': 1774032513.039344, 'last_price_update_time': 1774849154.336583}
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT46739') HTTP/1.1" 204 0
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-30 05:39:14 [auto1.de] INFO: Scrape type for YK97708: 2
2026-03-30 05:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-30 05:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dced7bc2-531f-54ee-95bb-752d839be3d0 with scrape type 2
2026-03-30 05:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dced7bc2-531f-54ee-95bb-752d839be3d0 with scrape type 2
2026-03-30 05:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dced7bc2-531f-54ee-95bb-752d839be3d0, identifier: YK97708
2026-03-30 05:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-30 05:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708
2026-03-30 05:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dced7bc2-531f-54ee-95bb-752d839be3d0 with identifier: YK97708 to the API
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:04:06Z',
 'fuel_type': 'petrol',
 'id': 'dced7bc2-531f-54ee-95bb-752d839be3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK97708',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 45629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-30 05:39:14 [auto1.de] INFO: Saving data for YK97708: {'auction_closing_time': 1774883046.0, 'created_time': 1774589459.395646, 'last_price_update_time': 1774849154.760748}
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK97708') HTTP/1.1" 204 0
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-30 05:39:14 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-30 05:39:14 [auto1.de] INFO: Scrape type for WR45011: 2
2026-03-30 05:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with identifier: WR45011
2026-03-30 05:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with scrape type 2
2026-03-30 05:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with scrape type 2
2026-03-30 05:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42f0c1a2-0ebf-5730-9ccd-e54909e10140, identifier: WR45011
2026-03-30 05:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with identifier: WR45011
2026-03-30 05:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with identifier: WR45011
2026-03-30 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42f0c1a2-0ebf-5730-9ccd-e54909e10140 with identifier: WR45011 to the API
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '42f0c1a2-0ebf-5730-9ccd-e54909e10140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR45011',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 131064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-26',
 'seller_name': None,
 'title': 'BMW 6er 650i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-30 05:39:15 [auto1.de] INFO: Saving data for WR45011: {'auction_closing_time': 1774885546.0, 'created_time': 1774639205.517202, 'last_price_update_time': 1774849155.246874}
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR45011') HTTP/1.1" 204 0
2026-03-30 05:39:15 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-30 05:39:15 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-30 05:39:15 [auto1.de] INFO: Scrape type for AU97741: 2
2026-03-30 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65632167-bbe0-57de-9195-994120c5837a with identifier: AU97741
2026-03-30 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65632167-bbe0-57de-9195-994120c5837a with scrape type 2
2026-03-30 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65632167-bbe0-57de-9195-994120c5837a with scrape type 2
2026-03-30 05:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65632167-bbe0-57de-9195-994120c5837a, identifier: AU97741
2026-03-30 05:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65632167-bbe0-57de-9195-994120c5837a with identifier: AU97741
2026-03-30 05:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65632167-bbe0-57de-9195-994120c5837a with identifier: AU97741
2026-03-30 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65632167-bbe0-57de-9195-994120c5837a with identifier: AU97741 to the API
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:29Z',
 'fuel_type': 'diesel',
 'id': '65632167-bbe0-57de-9195-994120c5837a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU97741',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 97112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Invite 4WD',
 'transmission': 'manual',
 'trim': 'Invite 4WD',
 'year': 2011}
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-30 05:39:15 [auto1.de] INFO: Saving data for AU97741: {'auction_closing_time': 1774883009.0, 'created_time': 1773303661.387543, 'last_price_update_time': 1774849155.663348}
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU97741') HTTP/1.1" 204 0
2026-03-30 05:39:15 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-30 05:39:15 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-30 05:39:15 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-30 05:39:15 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-30 05:39:15 [auto1.de] INFO: Scrape type for XE57640: 2
2026-03-30 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-30 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef6949b5-ec31-5639-9cb0-b18f69a3f914 with scrape type 2
2026-03-30 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef6949b5-ec31-5639-9cb0-b18f69a3f914 with scrape type 2
2026-03-30 05:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef6949b5-ec31-5639-9cb0-b18f69a3f914, identifier: XE57640
2026-03-30 05:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-30 05:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640
2026-03-30 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef6949b5-ec31-5639-9cb0-b18f69a3f914 with identifier: XE57640 to the API
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:07Z',
 'fuel_type': 'diesel',
 'id': 'ef6949b5-ec31-5639-9cb0-b18f69a3f914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE57640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 63635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Saving data for XE57640: {'auction_closing_time': 1774884307.0, 'created_time': 1774550621.417665, 'last_price_update_time': 1774849156.1022}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE57640') HTTP/1.1" 204 0
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Scrape type for EH89058: 2
2026-03-30 05:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165ad836-b8e3-5484-962a-211bd2b28cda with identifier: EH89058
2026-03-30 05:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165ad836-b8e3-5484-962a-211bd2b28cda with scrape type 2
2026-03-30 05:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 165ad836-b8e3-5484-962a-211bd2b28cda with scrape type 2
2026-03-30 05:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 165ad836-b8e3-5484-962a-211bd2b28cda, identifier: EH89058
2026-03-30 05:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 165ad836-b8e3-5484-962a-211bd2b28cda with identifier: EH89058
2026-03-30 05:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 165ad836-b8e3-5484-962a-211bd2b28cda with identifier: EH89058
2026-03-30 05:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 165ad836-b8e3-5484-962a-211bd2b28cda with identifier: EH89058 to the API
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '165ad836-b8e3-5484-962a-211bd2b28cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH89058',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 156682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2011}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Saving data for EH89058: {'auction_closing_time': 1774884596.0, 'created_time': 1773430032.683245, 'last_price_update_time': 1774849156.506791}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH89058') HTTP/1.1" 204 0
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-30 05:39:16 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Scrape type for TT11512: 2
2026-03-30 05:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with identifier: TT11512
2026-03-30 05:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with scrape type 2
2026-03-30 05:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with scrape type 2
2026-03-30 05:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2, identifier: TT11512
2026-03-30 05:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with identifier: TT11512
2026-03-30 05:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with identifier: TT11512
2026-03-30 05:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2 with identifier: TT11512 to the API
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:29:59Z',
 'fuel_type': 'diesel',
 'id': '7ccc39a3-8f3a-575d-a954-c0b0fe0f0fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT11512',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 243159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-12',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-30 05:39:16 [auto1.de] INFO: Saving data for TT11512: {'auction_closing_time': 1774884599.0, 'created_time': 1773303846.985391, 'last_price_update_time': 1774849156.927869}
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT11512') HTTP/1.1" 204 0
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for YU70640: 0
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for BS68722: 2
2026-03-30 05:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2581161c-b35b-5ce3-af96-e5ff03315d40 with identifier: BS68722
2026-03-30 05:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2581161c-b35b-5ce3-af96-e5ff03315d40 with scrape type 2
2026-03-30 05:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2581161c-b35b-5ce3-af96-e5ff03315d40 with scrape type 2
2026-03-30 05:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2581161c-b35b-5ce3-af96-e5ff03315d40, identifier: BS68722
2026-03-30 05:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2581161c-b35b-5ce3-af96-e5ff03315d40 with identifier: BS68722
2026-03-30 05:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2581161c-b35b-5ce3-af96-e5ff03315d40 with identifier: BS68722
2026-03-30 05:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2581161c-b35b-5ce3-af96-e5ff03315d40 with identifier: BS68722 to the API
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:07:52Z',
 'fuel_type': 'diesel',
 'id': '2581161c-b35b-5ce3-af96-e5ff03315d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS68722',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 235125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Saving data for BS68722: {'auction_closing_time': 1774883272.0, 'created_time': 1773224977.975684, 'last_price_update_time': 1774849157.456114}
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS68722') HTTP/1.1" 204 0
2026-03-30 05:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 05:39:17 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for WV53584: 0
2026-03-30 05:39:17 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-30 05:39:17 [auto1.de] INFO: Scrape type for ZL89302: 2
2026-03-30 05:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9334bd-a6e4-553d-b158-0286ada6852c with identifier: ZL89302
2026-03-30 05:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9334bd-a6e4-553d-b158-0286ada6852c with scrape type 2
2026-03-30 05:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9334bd-a6e4-553d-b158-0286ada6852c with scrape type 2
2026-03-30 05:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d9334bd-a6e4-553d-b158-0286ada6852c, identifier: ZL89302
2026-03-30 05:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d9334bd-a6e4-553d-b158-0286ada6852c with identifier: ZL89302
2026-03-30 05:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d9334bd-a6e4-553d-b158-0286ada6852c with identifier: ZL89302
2026-03-30 05:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d9334bd-a6e4-553d-b158-0286ada6852c with identifier: ZL89302 to the API
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:40Z',
 'fuel_type': 'petrol',
 'id': '0d9334bd-a6e4-553d-b158-0286ada6852c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL89302',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 49282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Saving data for ZL89302: {'auction_closing_time': 1774886320.0, 'created_time': 1774638920.234885, 'last_price_update_time': 1774849158.010136}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL89302') HTTP/1.1" 204 0
2026-03-30 05:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for KP94641: 2
2026-03-30 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33665fd7-9f94-5453-af62-acadac6e0aab with identifier: KP94641
2026-03-30 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33665fd7-9f94-5453-af62-acadac6e0aab with scrape type 2
2026-03-30 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33665fd7-9f94-5453-af62-acadac6e0aab with scrape type 2
2026-03-30 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33665fd7-9f94-5453-af62-acadac6e0aab, identifier: KP94641
2026-03-30 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33665fd7-9f94-5453-af62-acadac6e0aab with identifier: KP94641
2026-03-30 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33665fd7-9f94-5453-af62-acadac6e0aab with identifier: KP94641
2026-03-30 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33665fd7-9f94-5453-af62-acadac6e0aab with identifier: KP94641 to the API
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'diesel',
 'id': '33665fd7-9f94-5453-af62-acadac6e0aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP94641',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 59932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline lang',
 'transmission': 'manual',
 'trim': 'Comfortline lang',
 'year': 2016}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Saving data for KP94641: {'auction_closing_time': 1774886205.0, 'created_time': 1774349645.658195, 'last_price_update_time': 1774849158.428853}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP94641') HTTP/1.1" 204 0
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for FK64701: 2
2026-03-30 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-30 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9120448e-7eb1-56f0-a708-eb1845cc0385 with scrape type 2
2026-03-30 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9120448e-7eb1-56f0-a708-eb1845cc0385 with scrape type 2
2026-03-30 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9120448e-7eb1-56f0-a708-eb1845cc0385, identifier: FK64701
2026-03-30 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-30 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701
2026-03-30 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9120448e-7eb1-56f0-a708-eb1845cc0385 with identifier: FK64701 to the API
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:06Z',
 'fuel_type': 'diesel',
 'id': '9120448e-7eb1-56f0-a708-eb1845cc0385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK64701',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 74595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2017}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Saving data for FK64701: {'auction_closing_time': 1774885086.0, 'created_time': 1774550470.262047, 'last_price_update_time': 1774849158.930444}
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK64701') HTTP/1.1" 204 0
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-30 05:39:18 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-30 05:39:18 [auto1.de] INFO: Scrape type for KD99837: 2
2026-03-30 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca43c587-e424-5f78-b785-44faff3d6339 with identifier: KD99837
2026-03-30 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca43c587-e424-5f78-b785-44faff3d6339 with scrape type 2
2026-03-30 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca43c587-e424-5f78-b785-44faff3d6339 with scrape type 2
2026-03-30 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca43c587-e424-5f78-b785-44faff3d6339, identifier: KD99837
2026-03-30 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca43c587-e424-5f78-b785-44faff3d6339 with identifier: KD99837
2026-03-30 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca43c587-e424-5f78-b785-44faff3d6339 with identifier: KD99837
2026-03-30 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca43c587-e424-5f78-b785-44faff3d6339 with identifier: KD99837 to the API
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:20:32Z',
 'fuel_type': 'diesel',
 'id': 'ca43c587-e424-5f78-b785-44faff3d6339',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD99837',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 244176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-30 05:39:19 [auto1.de] INFO: Saving data for KD99837: {'auction_closing_time': 1774884032.0, 'created_time': 1774637380.308099, 'last_price_update_time': 1774849159.334259}
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD99837') HTTP/1.1" 204 0
2026-03-30 05:39:19 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 05:39:19 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-30 05:39:19 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-30 05:39:19 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 05:39:19 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-30 05:39:19 [auto1.de] INFO: Scrape type for GT92909: 2
2026-03-30 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54d50dbb-3be5-56f3-8130-18623abb1d72 with identifier: GT92909
2026-03-30 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54d50dbb-3be5-56f3-8130-18623abb1d72 with scrape type 2
2026-03-30 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54d50dbb-3be5-56f3-8130-18623abb1d72 with scrape type 2
2026-03-30 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54d50dbb-3be5-56f3-8130-18623abb1d72, identifier: GT92909
2026-03-30 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54d50dbb-3be5-56f3-8130-18623abb1d72 with identifier: GT92909
2026-03-30 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54d50dbb-3be5-56f3-8130-18623abb1d72 with identifier: GT92909
2026-03-30 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54d50dbb-3be5-56f3-8130-18623abb1d72 with identifier: GT92909 to the API
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'diesel',
 'id': '54d50dbb-3be5-56f3-8130-18623abb1d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT92909',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 209886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-25',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Trend blue 2WD',
 'transmission': 'automatic',
 'trim': 'Trend blue 2WD',
 'year': 2018}
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-30 05:39:19 [auto1.de] INFO: Saving data for GT92909: {'auction_closing_time': 1774884614.0, 'created_time': 1774639252.676625, 'last_price_update_time': 1774849159.794151}
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT92909') HTTP/1.1" 204 0
2026-03-30 05:39:19 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-30 05:39:19 [auto1.de] INFO: Scrape type for VR69124: 2
2026-03-30 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 632c4d12-9580-5e97-9c29-cfcc6e9c953b with identifier: VR69124
2026-03-30 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 632c4d12-9580-5e97-9c29-cfcc6e9c953b with scrape type 2
2026-03-30 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 632c4d12-9580-5e97-9c29-cfcc6e9c953b with scrape type 2
2026-03-30 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 632c4d12-9580-5e97-9c29-cfcc6e9c953b, identifier: VR69124
2026-03-30 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 632c4d12-9580-5e97-9c29-cfcc6e9c953b with identifier: VR69124
2026-03-30 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 632c4d12-9580-5e97-9c29-cfcc6e9c953b with identifier: VR69124
2026-03-30 05:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 632c4d12-9580-5e97-9c29-cfcc6e9c953b with identifier: VR69124 to the API
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'petrol',
 'id': '632c4d12-9580-5e97-9c29-cfcc6e9c953b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR69124',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 138597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Skoda Superb 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-30 05:39:20 [auto1.de] INFO: Saving data for VR69124: {'auction_closing_time': 1774886342.0, 'created_time': 1774638896.953136, 'last_price_update_time': 1774849160.184731}
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR69124') HTTP/1.1" 204 0
2026-03-30 05:39:20 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-30 05:39:20 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-30 05:39:20 [auto1.de] INFO: Scrape type for JT79226: 2
2026-03-30 05:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a116380-96b3-5adb-ae77-98c30ca7fa3c with identifier: JT79226
2026-03-30 05:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a116380-96b3-5adb-ae77-98c30ca7fa3c with scrape type 2
2026-03-30 05:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a116380-96b3-5adb-ae77-98c30ca7fa3c with scrape type 2
2026-03-30 05:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a116380-96b3-5adb-ae77-98c30ca7fa3c, identifier: JT79226
2026-03-30 05:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a116380-96b3-5adb-ae77-98c30ca7fa3c with identifier: JT79226
2026-03-30 05:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a116380-96b3-5adb-ae77-98c30ca7fa3c with identifier: JT79226
2026-03-30 05:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a116380-96b3-5adb-ae77-98c30ca7fa3c with identifier: JT79226 to the API
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:31:25Z',
 'fuel_type': 'petrol',
 'id': '5a116380-96b3-5adb-ae77-98c30ca7fa3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT79226',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 120354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'manual',
 'trim': 'GTI Performance BlueMotion',
 'year': 2018}
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-30 05:39:20 [auto1.de] INFO: Saving data for JT79226: {'auction_closing_time': 1774884685.0, 'created_time': 1774637470.757411, 'last_price_update_time': 1774849160.583549}
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT79226') HTTP/1.1" 204 0
2026-03-30 05:39:20 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-30 05:39:20 [auto1.de] INFO: Scrape type for SP71400: 0
2026-03-30 05:39:20 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-30 05:39:20 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-30 05:39:20 [auto1.de] INFO: Scrape type for FC27244: 2
2026-03-30 05:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b69d6d-8c31-5676-b799-92a547e3a294 with identifier: FC27244
2026-03-30 05:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b69d6d-8c31-5676-b799-92a547e3a294 with scrape type 2
2026-03-30 05:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b69d6d-8c31-5676-b799-92a547e3a294 with scrape type 2
2026-03-30 05:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b69d6d-8c31-5676-b799-92a547e3a294, identifier: FC27244
2026-03-30 05:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b69d6d-8c31-5676-b799-92a547e3a294 with identifier: FC27244
2026-03-30 05:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b69d6d-8c31-5676-b799-92a547e3a294 with identifier: FC27244
2026-03-30 05:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b69d6d-8c31-5676-b799-92a547e3a294 with identifier: FC27244 to the API
2026-03-30 05:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:23:52Z',
 'fuel_type': 'diesel',
 'id': 'c9b69d6d-8c31-5676-b799-92a547e3a294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC27244',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 131138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-30 05:39:21 [auto1.de] INFO: Saving data for FC27244: {'auction_closing_time': 1774884232.0, 'created_time': 1774639418.917772, 'last_price_update_time': 1774849161.777222}
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC27244') HTTP/1.1" 204 0
2026-03-30 05:39:21 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-30 05:39:21 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-30 05:39:21 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-30 05:39:21 [auto1.de] INFO: Scrape type for CR76399: 2
2026-03-30 05:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16649f2c-f660-5832-b305-6a38541ced43 with identifier: CR76399
2026-03-30 05:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16649f2c-f660-5832-b305-6a38541ced43 with scrape type 2
2026-03-30 05:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16649f2c-f660-5832-b305-6a38541ced43 with scrape type 2
2026-03-30 05:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16649f2c-f660-5832-b305-6a38541ced43, identifier: CR76399
2026-03-30 05:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16649f2c-f660-5832-b305-6a38541ced43 with identifier: CR76399
2026-03-30 05:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16649f2c-f660-5832-b305-6a38541ced43 with identifier: CR76399
2026-03-30 05:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16649f2c-f660-5832-b305-6a38541ced43 with identifier: CR76399 to the API
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:34Z',
 'fuel_type': 'petrol',
 'id': '16649f2c-f660-5832-b305-6a38541ced43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR76399',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 80430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-18',
 'seller_name': None,
 'title': 'Skoda Scala 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-30 05:39:22 [auto1.de] INFO: Saving data for CR76399: {'auction_closing_time': 1774884034.0, 'created_time': 1774636863.353062, 'last_price_update_time': 1774849162.235915}
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR76399') HTTP/1.1" 204 0
2026-03-30 05:39:22 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-30 05:39:22 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-30 05:39:22 [auto1.de] INFO: Scrape type for EY70159: 2
2026-03-30 05:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with identifier: EY70159
2026-03-30 05:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with scrape type 2
2026-03-30 05:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with scrape type 2
2026-03-30 05:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24, identifier: EY70159
2026-03-30 05:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with identifier: EY70159
2026-03-30 05:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with identifier: EY70159
2026-03-30 05:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24 with identifier: EY70159 to the API
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:29:57Z',
 'fuel_type': 'diesel',
 'id': 'f1799aba-6c9d-5d0d-afc4-7e6e11ef4a24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY70159',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 201274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-26',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Edition 25',
 'transmission': 'manual',
 'trim': 'Edition 25',
 'year': 2011}
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-30 05:39:22 [auto1.de] INFO: Saving data for EY70159: {'auction_closing_time': 1774884597.0, 'created_time': 1774639175.861867, 'last_price_update_time': 1774849162.641144}
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY70159') HTTP/1.1" 204 0
2026-03-30 05:39:22 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-30 05:39:22 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-30 05:39:22 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-30 05:39:22 [auto1.de] INFO: Scrape type for SR63884: 2
2026-03-30 05:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-30 05:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07043673-6e2f-5c93-82b3-417ca0e3cd73 with scrape type 2
2026-03-30 05:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07043673-6e2f-5c93-82b3-417ca0e3cd73 with scrape type 2
2026-03-30 05:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07043673-6e2f-5c93-82b3-417ca0e3cd73, identifier: SR63884
2026-03-30 05:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-30 05:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884
2026-03-30 05:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07043673-6e2f-5c93-82b3-417ca0e3cd73 with identifier: SR63884 to the API
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:39Z',
 'fuel_type': 'petrol',
 'id': '07043673-6e2f-5c93-82b3-417ca0e3cd73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR63884',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 224687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun 4Motion',
 'transmission': 'manual',
 'trim': 'Trend & Fun 4Motion',
 'year': 2008}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Saving data for SR63884: {'auction_closing_time': 1774883499.0, 'created_time': 1774552622.827031, 'last_price_update_time': 1774849163.089442}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR63884') HTTP/1.1" 204 0
2026-03-30 05:39:23 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Scrape type for EM38204: 2
2026-03-30 05:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99788215-f950-5660-9d47-9f8447e4cf37 with identifier: EM38204
2026-03-30 05:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99788215-f950-5660-9d47-9f8447e4cf37 with scrape type 2
2026-03-30 05:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99788215-f950-5660-9d47-9f8447e4cf37 with scrape type 2
2026-03-30 05:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99788215-f950-5660-9d47-9f8447e4cf37, identifier: EM38204
2026-03-30 05:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99788215-f950-5660-9d47-9f8447e4cf37 with identifier: EM38204
2026-03-30 05:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99788215-f950-5660-9d47-9f8447e4cf37 with identifier: EM38204
2026-03-30 05:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99788215-f950-5660-9d47-9f8447e4cf37 with identifier: EM38204 to the API
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:17:47Z',
 'fuel_type': 'petrol',
 'id': '99788215-f950-5660-9d47-9f8447e4cf37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM38204',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 65307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI R 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'R 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Saving data for EM38204: {'auction_closing_time': 1774883867.0, 'created_time': 1773302967.648569, 'last_price_update_time': 1774849163.491983}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM38204') HTTP/1.1" 204 0
2026-03-30 05:39:23 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:23 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-30 05:39:23 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-30 05:39:23 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-30 05:39:23 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Scrape type for UL19330: 2
2026-03-30 05:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-30 05:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03ed601f-4eea-5f9c-bb52-678231624924 with scrape type 2
2026-03-30 05:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03ed601f-4eea-5f9c-bb52-678231624924 with scrape type 2
2026-03-30 05:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03ed601f-4eea-5f9c-bb52-678231624924, identifier: UL19330
2026-03-30 05:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-30 05:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330
2026-03-30 05:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03ed601f-4eea-5f9c-bb52-678231624924 with identifier: UL19330 to the API
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:01:27Z',
 'fuel_type': 'petrol',
 'id': '03ed601f-4eea-5f9c-bb52-678231624924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL19330',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 117580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-22',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2004}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-30 05:39:23 [auto1.de] INFO: Saving data for UL19330: {'auction_closing_time': 1774882887.0, 'created_time': 1774551840.352429, 'last_price_update_time': 1774849163.904543}
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL19330') HTTP/1.1" 204 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for AJ08508: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for JF78286: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for VG01076: 2
2026-03-30 05:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94561eb5-fe46-53bc-8f40-418f7918f349 with identifier: VG01076
2026-03-30 05:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94561eb5-fe46-53bc-8f40-418f7918f349 with scrape type 2
2026-03-30 05:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94561eb5-fe46-53bc-8f40-418f7918f349 with scrape type 2
2026-03-30 05:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94561eb5-fe46-53bc-8f40-418f7918f349, identifier: VG01076
2026-03-30 05:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for DH60406: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 05:39:24 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Scrape type for ZT51756: 2
2026-03-30 05:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a346be29-8b5b-5fcc-9595-5144685f5cd4 with identifier: ZT51756
2026-03-30 05:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a346be29-8b5b-5fcc-9595-5144685f5cd4 with scrape type 2
2026-03-30 05:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a346be29-8b5b-5fcc-9595-5144685f5cd4 with scrape type 2
2026-03-30 05:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a346be29-8b5b-5fcc-9595-5144685f5cd4, identifier: ZT51756
2026-03-30 05:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94561eb5-fe46-53bc-8f40-418f7918f349 with identifier: VG01076
2026-03-30 05:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94561eb5-fe46-53bc-8f40-418f7918f349 with identifier: VG01076
2026-03-30 05:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94561eb5-fe46-53bc-8f40-418f7918f349 with identifier: VG01076 to the API
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:50:05Z',
 'fuel_type': 'diesel',
 'id': '94561eb5-fe46-53bc-8f40-418f7918f349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG01076',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 65190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-30 05:39:24 [auto1.de] INFO: Saving data for VG01076: {'auction_closing_time': 1774885805.0, 'created_time': 1774637839.262308, 'last_price_update_time': 1774849164.856934}
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG01076') HTTP/1.1" 204 0
2026-03-30 05:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a346be29-8b5b-5fcc-9595-5144685f5cd4 with identifier: ZT51756
2026-03-30 05:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a346be29-8b5b-5fcc-9595-5144685f5cd4 with identifier: ZT51756
2026-03-30 05:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a346be29-8b5b-5fcc-9595-5144685f5cd4 with identifier: ZT51756 to the API
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:11:41Z',
 'fuel_type': 'petrol',
 'id': 'a346be29-8b5b-5fcc-9595-5144685f5cd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT51756',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 117567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2009}
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Saving data for ZT51756: {'auction_closing_time': 1774883501.0, 'created_time': 1774639175.501271, 'last_price_update_time': 1774849165.231727}
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT51756') HTTP/1.1" 204 0
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Scrape type for WT94690: 2
2026-03-30 05:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8de4bd75-c168-5b16-97a6-82226192aeee with identifier: WT94690
2026-03-30 05:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8de4bd75-c168-5b16-97a6-82226192aeee with scrape type 2
2026-03-30 05:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8de4bd75-c168-5b16-97a6-82226192aeee with scrape type 2
2026-03-30 05:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8de4bd75-c168-5b16-97a6-82226192aeee, identifier: WT94690
2026-03-30 05:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8de4bd75-c168-5b16-97a6-82226192aeee with identifier: WT94690
2026-03-30 05:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8de4bd75-c168-5b16-97a6-82226192aeee with identifier: WT94690
2026-03-30 05:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8de4bd75-c168-5b16-97a6-82226192aeee with identifier: WT94690 to the API
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:56Z',
 'fuel_type': 'diesel',
 'id': '8de4bd75-c168-5b16-97a6-82226192aeee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT94690',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 119325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Saving data for WT94690: {'auction_closing_time': 1774885496.0, 'created_time': 1774638971.503345, 'last_price_update_time': 1774849165.633896}
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT94690') HTTP/1.1" 204 0
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-30 05:39:25 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-30 05:39:25 [auto1.de] INFO: Scrape type for JH92340: 2
2026-03-30 05:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52826087-d8bd-58b2-90da-c942b6e4282b with identifier: JH92340
2026-03-30 05:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52826087-d8bd-58b2-90da-c942b6e4282b with scrape type 2
2026-03-30 05:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52826087-d8bd-58b2-90da-c942b6e4282b with scrape type 2
2026-03-30 05:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52826087-d8bd-58b2-90da-c942b6e4282b, identifier: JH92340
2026-03-30 05:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52826087-d8bd-58b2-90da-c942b6e4282b with identifier: JH92340
2026-03-30 05:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52826087-d8bd-58b2-90da-c942b6e4282b with identifier: JH92340
2026-03-30 05:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52826087-d8bd-58b2-90da-c942b6e4282b with identifier: JH92340 to the API
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:47Z',
 'fuel_type': 'petrol',
 'id': '52826087-d8bd-58b2-90da-c942b6e4282b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH92340',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 92096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Fiat 500 0.9 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2014}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Saving data for JH92340: {'auction_closing_time': 1774885187.0, 'created_time': 1774637464.760867, 'last_price_update_time': 1774849166.099329}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH92340') HTTP/1.1" 204 0
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Scrape type for FY22177: 2
2026-03-30 05:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-30 05:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e59ee88a-eca5-529c-9114-be1793f37cd1 with scrape type 2
2026-03-30 05:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e59ee88a-eca5-529c-9114-be1793f37cd1 with scrape type 2
2026-03-30 05:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e59ee88a-eca5-529c-9114-be1793f37cd1, identifier: FY22177
2026-03-30 05:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-30 05:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177
2026-03-30 05:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e59ee88a-eca5-529c-9114-be1793f37cd1 with identifier: FY22177 to the API
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:42:24Z',
 'fuel_type': 'petrol',
 'id': 'e59ee88a-eca5-529c-9114-be1793f37cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY22177',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 126172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2014}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Saving data for FY22177: {'auction_closing_time': 1774885344.0, 'created_time': 1774550439.587098, 'last_price_update_time': 1774849166.50209}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY22177') HTTP/1.1" 204 0
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-30 05:39:26 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Scrape type for JL01177: 2
2026-03-30 05:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with identifier: JL01177
2026-03-30 05:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with scrape type 2
2026-03-30 05:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with scrape type 2
2026-03-30 05:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f, identifier: JL01177
2026-03-30 05:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with identifier: JL01177
2026-03-30 05:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with identifier: JL01177
2026-03-30 05:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f with identifier: JL01177 to the API
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:48Z',
 'fuel_type': 'diesel',
 'id': 'e0fc25e9-9dd7-5c1c-94aa-e8b9c910a92f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL01177',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 204191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-10',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2009}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-30 05:39:26 [auto1.de] INFO: Saving data for JL01177: {'auction_closing_time': 1774883328.0, 'created_time': 1774637172.707558, 'last_price_update_time': 1774849166.967359}
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL01177') HTTP/1.1" 204 0
2026-03-30 05:39:27 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Scrape type for PP80168: 2
2026-03-30 05:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with identifier: PP80168
2026-03-30 05:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with scrape type 2
2026-03-30 05:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with scrape type 2
2026-03-30 05:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e29d3e2-436c-55f7-a346-76eb11ef56f6, identifier: PP80168
2026-03-30 05:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with identifier: PP80168
2026-03-30 05:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with identifier: PP80168
2026-03-30 05:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e29d3e2-436c-55f7-a346-76eb11ef56f6 with identifier: PP80168 to the API
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:52Z',
 'fuel_type': 'diesel',
 'id': '5e29d3e2-436c-55f7-a346-76eb11ef56f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP80168',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 71100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-11',
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Saving data for PP80168: {'auction_closing_time': 1774885372.0, 'created_time': 1774264784.884771, 'last_price_update_time': 1774849167.450887}
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP80168') HTTP/1.1" 204 0
2026-03-30 05:39:27 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Scrape type for NG76002: 2
2026-03-30 05:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-30 05:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21738d5d-26fe-5565-be2a-aa5853066b04 with scrape type 2
2026-03-30 05:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21738d5d-26fe-5565-be2a-aa5853066b04 with scrape type 2
2026-03-30 05:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21738d5d-26fe-5565-be2a-aa5853066b04, identifier: NG76002
2026-03-30 05:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-30 05:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002
2026-03-30 05:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21738d5d-26fe-5565-be2a-aa5853066b04 with identifier: NG76002 to the API
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:38Z',
 'fuel_type': 'diesel',
 'id': '21738d5d-26fe-5565-be2a-aa5853066b04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG76002',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 152714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Saving data for NG76002: {'auction_closing_time': 1774886258.0, 'created_time': 1774552696.129057, 'last_price_update_time': 1774849167.855639}
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG76002') HTTP/1.1" 204 0
2026-03-30 05:39:27 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-30 05:39:27 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-30 05:39:27 [auto1.de] INFO: Scrape type for RC80403: 2
2026-03-30 05:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17bdb3b1-216f-56ba-9219-50dff801d49f with identifier: RC80403
2026-03-30 05:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17bdb3b1-216f-56ba-9219-50dff801d49f with scrape type 2
2026-03-30 05:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17bdb3b1-216f-56ba-9219-50dff801d49f with scrape type 2
2026-03-30 05:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17bdb3b1-216f-56ba-9219-50dff801d49f, identifier: RC80403
2026-03-30 05:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17bdb3b1-216f-56ba-9219-50dff801d49f with identifier: RC80403
2026-03-30 05:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17bdb3b1-216f-56ba-9219-50dff801d49f with identifier: RC80403
2026-03-30 05:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17bdb3b1-216f-56ba-9219-50dff801d49f with identifier: RC80403 to the API
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'diesel',
 'id': '17bdb3b1-216f-56ba-9219-50dff801d49f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC80403',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 166547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Tekna 4x4',
 'transmission': 'manual',
 'trim': 'Tekna 4x4',
 'year': 2016}
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Saving data for RC80403: {'auction_closing_time': 1774884832.0, 'created_time': 1774638235.691437, 'last_price_update_time': 1774849168.306157}
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC80403') HTTP/1.1" 204 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for MV27472: 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for XR73410: 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-30 05:39:28 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Scrape type for PR32906: 2
2026-03-30 05:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c737ea11-ef45-5a27-af33-46e1705e2cd8 with identifier: PR32906
2026-03-30 05:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c737ea11-ef45-5a27-af33-46e1705e2cd8 with scrape type 2
2026-03-30 05:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c737ea11-ef45-5a27-af33-46e1705e2cd8 with scrape type 2
2026-03-30 05:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c737ea11-ef45-5a27-af33-46e1705e2cd8, identifier: PR32906
2026-03-30 05:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c737ea11-ef45-5a27-af33-46e1705e2cd8 with identifier: PR32906
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 05:39:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 05:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c737ea11-ef45-5a27-af33-46e1705e2cd8 with identifier: PR32906
2026-03-30 05:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c737ea11-ef45-5a27-af33-46e1705e2cd8 with identifier: PR32906 to the API
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:20:12Z',
 'fuel_type': 'diesel',
 'id': 'c737ea11-ef45-5a27-af33-46e1705e2cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR32906',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 227697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-30 05:39:28 [auto1.de] INFO: Saving data for PR32906: {'auction_closing_time': 1774884012.0, 'created_time': 1774637093.662651, 'last_price_update_time': 1774849168.913694}
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR32906') HTTP/1.1" 204 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for BG13835: 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for ZD84444: 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-30 05:39:29 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for KY24056: 2
2026-03-30 05:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65c784b-9990-5176-af31-d8ab47dbbd7a with identifier: KY24056
2026-03-30 05:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65c784b-9990-5176-af31-d8ab47dbbd7a with scrape type 2
2026-03-30 05:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e65c784b-9990-5176-af31-d8ab47dbbd7a with scrape type 2
2026-03-30 05:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e65c784b-9990-5176-af31-d8ab47dbbd7a, identifier: KY24056
2026-03-30 05:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e65c784b-9990-5176-af31-d8ab47dbbd7a with identifier: KY24056
2026-03-30 05:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e65c784b-9990-5176-af31-d8ab47dbbd7a with identifier: KY24056
2026-03-30 05:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e65c784b-9990-5176-af31-d8ab47dbbd7a with identifier: KY24056 to the API
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:48:45Z',
 'fuel_type': 'diesel',
 'id': 'e65c784b-9990-5176-af31-d8ab47dbbd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY24056',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 152388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-11',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2013}
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Saving data for KY24056: {'auction_closing_time': 1774885725.0, 'created_time': 1774550533.588106, 'last_price_update_time': 1774849169.533324}
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY24056') HTTP/1.1" 204 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for AS79616: 2
2026-03-30 05:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-30 05:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2a7e67c-4c78-5406-a70a-3e2ede768348 with scrape type 2
2026-03-30 05:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2a7e67c-4c78-5406-a70a-3e2ede768348 with scrape type 2
2026-03-30 05:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2a7e67c-4c78-5406-a70a-3e2ede768348, identifier: AS79616
2026-03-30 05:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-30 05:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616
2026-03-30 05:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2a7e67c-4c78-5406-a70a-3e2ede768348 with identifier: AS79616 to the API
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:24Z',
 'fuel_type': 'petrol',
 'id': 'f2a7e67c-4c78-5406-a70a-3e2ede768348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS79616',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 52043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Tendance',
 'transmission': 'automatic',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Saving data for AS79616: {'auction_closing_time': 1774883604.0, 'created_time': 1774552674.253749, 'last_price_update_time': 1774849169.931125}
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS79616') HTTP/1.1" 204 0
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-30 05:39:29 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-30 05:39:29 [auto1.de] INFO: Scrape type for RK05347: 2
2026-03-30 05:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be8f8831-6058-5eeb-9dc0-d97fe86f2566 with identifier: RK05347
2026-03-30 05:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be8f8831-6058-5eeb-9dc0-d97fe86f2566 with scrape type 2
2026-03-30 05:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be8f8831-6058-5eeb-9dc0-d97fe86f2566 with scrape type 2
2026-03-30 05:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be8f8831-6058-5eeb-9dc0-d97fe86f2566, identifier: RK05347
2026-03-30 05:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be8f8831-6058-5eeb-9dc0-d97fe86f2566 with identifier: RK05347
2026-03-30 05:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be8f8831-6058-5eeb-9dc0-d97fe86f2566 with identifier: RK05347
2026-03-30 05:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be8f8831-6058-5eeb-9dc0-d97fe86f2566 with identifier: RK05347 to the API
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:33:02Z',
 'fuel_type': 'petrol',
 'id': 'be8f8831-6058-5eeb-9dc0-d97fe86f2566',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK05347',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 118403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-13',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 JBL',
 'transmission': 'manual',
 'trim': 'JBL',
 'year': 2009}
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-30 05:39:30 [auto1.de] INFO: Saving data for RK05347: {'auction_closing_time': 1774884782.0, 'created_time': 1774639020.872486, 'last_price_update_time': 1774849170.340145}
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK05347') HTTP/1.1" 204 0
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-30 05:39:30 [auto1.de] INFO: Scrape type for XC86778: 2
2026-03-30 05:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with identifier: XC86778
2026-03-30 05:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with scrape type 2
2026-03-30 05:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with scrape type 2
2026-03-30 05:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ae3ea2-508e-59e4-bcb5-c1c1745d803f, identifier: XC86778
2026-03-30 05:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with identifier: XC86778
2026-03-30 05:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with identifier: XC86778
2026-03-30 05:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ae3ea2-508e-59e4-bcb5-c1c1745d803f with identifier: XC86778 to the API
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 425,
 'expiration_date': '2026-03-30T15:34:02Z',
 'fuel_type': 'petrol',
 'id': 'c0ae3ea2-508e-59e4-bcb5-c1c1745d803f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC86778',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 132295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-22',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.1 SRT8',
 'transmission': 'automatic',
 'trim': 'SRT8',
 'year': 2007}
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-30 05:39:30 [auto1.de] INFO: Saving data for XC86778: {'auction_closing_time': 1774884842.0, 'created_time': 1773307973.302452, 'last_price_update_time': 1774849170.840875}
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC86778') HTTP/1.1" 204 0
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-30 05:39:30 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-30 05:39:30 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-30 05:39:30 [auto1.de] INFO: Scrape type for EU14663: 2
2026-03-30 05:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with identifier: EU14663
2026-03-30 05:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with scrape type 2
2026-03-30 05:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with scrape type 2
2026-03-30 05:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ea46f3f-78ee-5f42-b699-0c0c297dcc55, identifier: EU14663
2026-03-30 05:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with identifier: EU14663
2026-03-30 05:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with identifier: EU14663
2026-03-30 05:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ea46f3f-78ee-5f42-b699-0c0c297dcc55 with identifier: EU14663 to the API
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:35Z',
 'fuel_type': 'petrol',
 'id': '5ea46f3f-78ee-5f42-b699-0c0c297dcc55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU14663',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 119968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-30 05:39:31 [auto1.de] INFO: Saving data for EU14663: {'auction_closing_time': 1774884755.0, 'created_time': 1774637092.440616, 'last_price_update_time': 1774849171.580644}
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU14663') HTTP/1.1" 204 0
2026-03-30 05:39:31 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-30 05:39:31 [auto1.de] INFO: Scrape type for MK09620: 2
2026-03-30 05:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-30 05:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2286d723-cbbf-534a-a0a2-66ca006b57e9 with scrape type 2
2026-03-30 05:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2286d723-cbbf-534a-a0a2-66ca006b57e9 with scrape type 2
2026-03-30 05:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2286d723-cbbf-534a-a0a2-66ca006b57e9, identifier: MK09620
2026-03-30 05:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-30 05:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620
2026-03-30 05:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2286d723-cbbf-534a-a0a2-66ca006b57e9 with identifier: MK09620 to the API
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:04:10Z',
 'fuel_type': 'petrol',
 'id': '2286d723-cbbf-534a-a0a2-66ca006b57e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK09620',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 30401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-30 05:39:31 [auto1.de] INFO: Saving data for MK09620: {'auction_closing_time': 1774883050.0, 'created_time': 1774552658.119792, 'last_price_update_time': 1774849171.977032}
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK09620') HTTP/1.1" 204 0
2026-03-30 05:39:31 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Scrape type for FK93420: 2
2026-03-30 05:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 804f1ef9-397c-5341-9023-b616946a3e65 with identifier: FK93420
2026-03-30 05:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 804f1ef9-397c-5341-9023-b616946a3e65 with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 804f1ef9-397c-5341-9023-b616946a3e65 with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 804f1ef9-397c-5341-9023-b616946a3e65, identifier: FK93420
2026-03-30 05:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 804f1ef9-397c-5341-9023-b616946a3e65 with identifier: FK93420
2026-03-30 05:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 804f1ef9-397c-5341-9023-b616946a3e65 with identifier: FK93420
2026-03-30 05:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 804f1ef9-397c-5341-9023-b616946a3e65 with identifier: FK93420 to the API
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:53Z',
 'fuel_type': 'petrol',
 'id': '804f1ef9-397c-5341-9023-b616946a3e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK93420',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 133497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.4 First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2008}
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Saving data for FK93420: {'auction_closing_time': 1774883873.0, 'created_time': 1774550007.462795, 'last_price_update_time': 1774849172.419664}
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK93420') HTTP/1.1" 204 0
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Scrape type for BS96565: 2
2026-03-30 05:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-30 05:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afa26326-fdc7-5abf-8722-d7007a83cb1b with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afa26326-fdc7-5abf-8722-d7007a83cb1b with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afa26326-fdc7-5abf-8722-d7007a83cb1b, identifier: BS96565
2026-03-30 05:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-30 05:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565
2026-03-30 05:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afa26326-fdc7-5abf-8722-d7007a83cb1b with identifier: BS96565 to the API
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:56:08Z',
 'fuel_type': 'petrol',
 'id': 'afa26326-fdc7-5abf-8722-d7007a83cb1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS96565',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 87638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Vision 2WD',
 'transmission': 'automatic',
 'trim': 'Vision 2WD',
 'year': 2020}
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Saving data for BS96565: {'auction_closing_time': 1774886168.0, 'created_time': 1774675842.361821, 'last_price_update_time': 1774849172.815959}
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS96565') HTTP/1.1" 204 0
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-30 05:39:32 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-30 05:39:32 [auto1.de] INFO: Scrape type for TP67168: 2
2026-03-30 05:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-30 05:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfd4d367-55fa-520f-ac5a-74219e842e77 with scrape type 2
2026-03-30 05:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfd4d367-55fa-520f-ac5a-74219e842e77, identifier: TP67168
2026-03-30 05:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-30 05:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168
2026-03-30 05:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfd4d367-55fa-520f-ac5a-74219e842e77 with identifier: TP67168 to the API
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:29:31Z',
 'fuel_type': 'diesel',
 'id': 'bfd4d367-55fa-520f-ac5a-74219e842e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP67168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 290646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueTDI',
 'transmission': 'manual',
 'trim': 'Comfortline BlueTDI',
 'year': 2012}
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-30 05:39:33 [auto1.de] INFO: Saving data for TP67168: {'auction_closing_time': 1774884571.0, 'created_time': 1774552845.937505, 'last_price_update_time': 1774849173.524422}
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP67168') HTTP/1.1" 204 0
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-30 05:39:33 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-30 05:39:33 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-30 05:39:33 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-30 05:39:33 [auto1.de] INFO: Scrape type for YA08526: 2
2026-03-30 05:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca242c52-8b6c-560b-be49-2ed426c39649 with identifier: YA08526
2026-03-30 05:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca242c52-8b6c-560b-be49-2ed426c39649 with scrape type 2
2026-03-30 05:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca242c52-8b6c-560b-be49-2ed426c39649 with scrape type 2
2026-03-30 05:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca242c52-8b6c-560b-be49-2ed426c39649, identifier: YA08526
2026-03-30 05:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca242c52-8b6c-560b-be49-2ed426c39649 with identifier: YA08526
2026-03-30 05:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca242c52-8b6c-560b-be49-2ed426c39649 with identifier: YA08526
2026-03-30 05:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca242c52-8b6c-560b-be49-2ed426c39649 with identifier: YA08526 to the API
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:19:04Z',
 'fuel_type': 'diesel',
 'id': 'ca242c52-8b6c-560b-be49-2ed426c39649',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA08526',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 126207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.5 Blue dCi Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2020}
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Saving data for YA08526: {'auction_closing_time': 1774883944.0, 'created_time': 1774639145.635187, 'last_price_update_time': 1774849174.080468}
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA08526') HTTP/1.1" 204 0
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Scrape type for YM60092: 2
2026-03-30 05:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e51b5f14-6b0f-5984-bfd2-14d154bd82ad with identifier: YM60092
2026-03-30 05:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e51b5f14-6b0f-5984-bfd2-14d154bd82ad with scrape type 2
2026-03-30 05:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e51b5f14-6b0f-5984-bfd2-14d154bd82ad with scrape type 2
2026-03-30 05:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e51b5f14-6b0f-5984-bfd2-14d154bd82ad, identifier: YM60092
2026-03-30 05:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e51b5f14-6b0f-5984-bfd2-14d154bd82ad with identifier: YM60092
2026-03-30 05:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e51b5f14-6b0f-5984-bfd2-14d154bd82ad with identifier: YM60092
2026-03-30 05:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e51b5f14-6b0f-5984-bfd2-14d154bd82ad with identifier: YM60092 to the API
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:01Z',
 'fuel_type': 'diesel',
 'id': 'e51b5f14-6b0f-5984-bfd2-14d154bd82ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM60092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 337748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Saving data for YM60092: {'auction_closing_time': 1774886161.0, 'created_time': 1774639039.968146, 'last_price_update_time': 1774849174.477092}
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM60092') HTTP/1.1" 204 0
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Scrape type for GU28360: 0
2026-03-30 05:39:34 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-30 05:39:34 [auto1.de] INFO: Scrape type for GL23432: 2
2026-03-30 05:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-30 05:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with scrape type 2
2026-03-30 05:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with scrape type 2
2026-03-30 05:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9591047-a5c8-53e7-a541-fdb2f4fe8b82, identifier: GL23432
2026-03-30 05:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-30 05:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432
2026-03-30 05:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9591047-a5c8-53e7-a541-fdb2f4fe8b82 with identifier: GL23432 to the API
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'diesel',
 'id': 'b9591047-a5c8-53e7-a541-fdb2f4fe8b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL23432',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 206230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2012}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Saving data for GL23432: {'auction_closing_time': 1774884277.0, 'created_time': 1774550764.021375, 'last_price_update_time': 1774849175.028841}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL23432') HTTP/1.1" 204 0
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Scrape type for NY39865: 0
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Scrape type for YM89123: 2
2026-03-30 05:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f4b885-69fd-565f-ae86-3c626b29ef78 with identifier: YM89123
2026-03-30 05:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f4b885-69fd-565f-ae86-3c626b29ef78 with scrape type 2
2026-03-30 05:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69f4b885-69fd-565f-ae86-3c626b29ef78 with scrape type 2
2026-03-30 05:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69f4b885-69fd-565f-ae86-3c626b29ef78, identifier: YM89123
2026-03-30 05:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69f4b885-69fd-565f-ae86-3c626b29ef78 with identifier: YM89123
2026-03-30 05:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69f4b885-69fd-565f-ae86-3c626b29ef78 with identifier: YM89123
2026-03-30 05:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69f4b885-69fd-565f-ae86-3c626b29ef78 with identifier: YM89123 to the API
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:01:54Z',
 'fuel_type': 'diesel',
 'id': '69f4b885-69fd-565f-ae86-3c626b29ef78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM89123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 196660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-05',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2015}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Saving data for YM89123: {'auction_closing_time': 1774882914.0, 'created_time': 1773228627.593303, 'last_price_update_time': 1774849175.454176}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM89123') HTTP/1.1" 204 0
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Scrape type for JE20553: 2
2026-03-30 05:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f75d5a08-da5d-519e-a193-31a37b13a189 with identifier: JE20553
2026-03-30 05:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f75d5a08-da5d-519e-a193-31a37b13a189 with scrape type 2
2026-03-30 05:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f75d5a08-da5d-519e-a193-31a37b13a189 with scrape type 2
2026-03-30 05:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f75d5a08-da5d-519e-a193-31a37b13a189, identifier: JE20553
2026-03-30 05:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f75d5a08-da5d-519e-a193-31a37b13a189 with identifier: JE20553
2026-03-30 05:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f75d5a08-da5d-519e-a193-31a37b13a189 with identifier: JE20553
2026-03-30 05:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f75d5a08-da5d-519e-a193-31a37b13a189 with identifier: JE20553 to the API
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:16Z',
 'fuel_type': 'diesel',
 'id': 'f75d5a08-da5d-519e-a193-31a37b13a189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE20553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 291522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2015}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-30 05:39:35 [auto1.de] INFO: Saving data for JE20553: {'auction_closing_time': 1774883476.0, 'created_time': 1774639392.630689, 'last_price_update_time': 1774849175.869381}
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE20553') HTTP/1.1" 204 0
2026-03-30 05:39:35 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 05:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:36 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-30 05:39:36 [auto1.de] INFO: Scrape type for HE95833: 2
2026-03-30 05:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93c0f65b-5449-5fab-9ff6-8b00c406f31f with identifier: HE95833
2026-03-30 05:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93c0f65b-5449-5fab-9ff6-8b00c406f31f with scrape type 2
2026-03-30 05:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93c0f65b-5449-5fab-9ff6-8b00c406f31f with scrape type 2
2026-03-30 05:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93c0f65b-5449-5fab-9ff6-8b00c406f31f, identifier: HE95833
2026-03-30 05:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93c0f65b-5449-5fab-9ff6-8b00c406f31f with identifier: HE95833
2026-03-30 05:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93c0f65b-5449-5fab-9ff6-8b00c406f31f with identifier: HE95833
2026-03-30 05:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93c0f65b-5449-5fab-9ff6-8b00c406f31f with identifier: HE95833 to the API
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:32Z',
 'fuel_type': 'diesel',
 'id': '93c0f65b-5449-5fab-9ff6-8b00c406f31f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE95833',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 129637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-30 05:39:36 [auto1.de] INFO: Saving data for HE95833: {'auction_closing_time': 1774886372.0, 'created_time': 1774637653.925304, 'last_price_update_time': 1774849176.794973}
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE95833') HTTP/1.1" 204 0
2026-03-30 05:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-30 05:39:36 [auto1.de] INFO: Scrape type for BH40486: 0
2026-03-30 05:39:36 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-30 05:39:36 [auto1.de] INFO: Scrape type for PJ72661: 2
2026-03-30 05:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1139fbff-b388-547f-8360-bb81922cb8e8 with identifier: PJ72661
2026-03-30 05:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1139fbff-b388-547f-8360-bb81922cb8e8 with scrape type 2
2026-03-30 05:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1139fbff-b388-547f-8360-bb81922cb8e8 with scrape type 2
2026-03-30 05:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1139fbff-b388-547f-8360-bb81922cb8e8, identifier: PJ72661
2026-03-30 05:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1139fbff-b388-547f-8360-bb81922cb8e8 with identifier: PJ72661
2026-03-30 05:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1139fbff-b388-547f-8360-bb81922cb8e8 with identifier: PJ72661
2026-03-30 05:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1139fbff-b388-547f-8360-bb81922cb8e8 with identifier: PJ72661 to the API
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:47:35Z',
 'fuel_type': 'petrol',
 'id': '1139fbff-b388-547f-8360-bb81922cb8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ72661',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 94716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-09',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2012}
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Saving data for PJ72661: {'auction_closing_time': 1774885655.0, 'created_time': 1774638214.166902, 'last_price_update_time': 1774849177.337202}
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ72661') HTTP/1.1" 204 0
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Scrape type for FC58368: 0
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Scrape type for TR16166: 2
2026-03-30 05:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with identifier: TR16166
2026-03-30 05:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with scrape type 2
2026-03-30 05:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with scrape type 2
2026-03-30 05:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65e1a11c-71f6-5d1c-a7d5-8daf9781b717, identifier: TR16166
2026-03-30 05:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with identifier: TR16166
2026-03-30 05:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with identifier: TR16166
2026-03-30 05:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65e1a11c-71f6-5d1c-a7d5-8daf9781b717 with identifier: TR16166 to the API
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:41Z',
 'fuel_type': 'petrol',
 'id': '65e1a11c-71f6-5d1c-a7d5-8daf9781b717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR16166',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 17300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Saving data for TR16166: {'auction_closing_time': 1774885661.0, 'created_time': 1773946327.780611, 'last_price_update_time': 1774849177.782935}
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR16166') HTTP/1.1" 204 0
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-30 05:39:37 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-30 05:39:37 [auto1.de] INFO: Scrape type for TL72428: 2
2026-03-30 05:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-30 05:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b94db271-a14b-564f-9aac-dde63c936ee6 with scrape type 2
2026-03-30 05:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b94db271-a14b-564f-9aac-dde63c936ee6 with scrape type 2
2026-03-30 05:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b94db271-a14b-564f-9aac-dde63c936ee6, identifier: TL72428
2026-03-30 05:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-30 05:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428
2026-03-30 05:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b94db271-a14b-564f-9aac-dde63c936ee6 with identifier: TL72428 to the API
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:44:56Z',
 'fuel_type': 'petrol',
 'id': 'b94db271-a14b-564f-9aac-dde63c936ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL72428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2015}
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-30 05:39:38 [auto1.de] INFO: Saving data for TL72428: {'auction_closing_time': 1774885496.0, 'created_time': 1774552959.874613, 'last_price_update_time': 1774849178.253333}
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL72428') HTTP/1.1" 204 0
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-30 05:39:38 [auto1.de] INFO: Scrape type for CN22561: 2
2026-03-30 05:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-30 05:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with scrape type 2
2026-03-30 05:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with scrape type 2
2026-03-30 05:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9, identifier: CN22561
2026-03-30 05:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-30 05:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561
2026-03-30 05:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a2d07c6-64f5-5513-8fdf-3c5337c86bc9 with identifier: CN22561 to the API
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:49:10Z',
 'fuel_type': 'petrol',
 'id': '4a2d07c6-64f5-5513-8fdf-3c5337c86bc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN22561',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT RS',
 'odometer': 69606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-04',
 'seller_name': None,
 'title': 'Audi TT RS 2.5 TFSI quattro Roadster',
 'transmission': 'automatic',
 'trim': 'quattro Roadster',
 'year': 2013}
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-30 05:39:38 [auto1.de] INFO: Saving data for CN22561: {'auction_closing_time': 1774885750.0, 'created_time': 1773945895.532458, 'last_price_update_time': 1774849178.734914}
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN22561') HTTP/1.1" 204 0
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-30 05:39:38 [auto1.de] INFO: Scrape type for CT75216: 0
2026-03-30 05:39:38 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-30 05:39:38 [auto1.de] INFO: Scrape type for NV84142: 2
2026-03-30 05:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with identifier: NV84142
2026-03-30 05:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with scrape type 2
2026-03-30 05:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with scrape type 2
2026-03-30 05:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd42efd2-f2b9-592b-b59a-354a2a29cdc7, identifier: NV84142
2026-03-30 05:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with identifier: NV84142
2026-03-30 05:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with identifier: NV84142
2026-03-30 05:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd42efd2-f2b9-592b-b59a-354a2a29cdc7 with identifier: NV84142 to the API
2026-03-30 05:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:39:46Z',
 'fuel_type': 'petrol',
 'id': 'bd42efd2-f2b9-592b-b59a-354a2a29cdc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV84142',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 115429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2016}
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Saving data for NV84142: {'auction_closing_time': 1774885186.0, 'created_time': 1773916257.165137, 'last_price_update_time': 1774849179.157994}
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV84142') HTTP/1.1" 204 0
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Scrape type for WN20430: 2
2026-03-30 05:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-30 05:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with scrape type 2
2026-03-30 05:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with scrape type 2
2026-03-30 05:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d327382-3ce5-5c8f-bae1-5b97ce914a76, identifier: WN20430
2026-03-30 05:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-30 05:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430
2026-03-30 05:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d327382-3ce5-5c8f-bae1-5b97ce914a76 with identifier: WN20430 to the API
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:36Z',
 'fuel_type': 'diesel',
 'id': '8d327382-3ce5-5c8f-bae1-5b97ce914a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN20430',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 193056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Saving data for WN20430: {'auction_closing_time': 1774885236.0, 'created_time': 1774550420.211448, 'last_price_update_time': 1774849179.589452}
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN20430') HTTP/1.1" 204 0
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 05:39:39 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-30 05:39:39 [auto1.de] INFO: Scrape type for CP55762: 2
2026-03-30 05:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with identifier: CP55762
2026-03-30 05:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with scrape type 2
2026-03-30 05:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with scrape type 2
2026-03-30 05:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6997c85-2dcd-5f5c-a1b9-9c65149a03d7, identifier: CP55762
2026-03-30 05:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with identifier: CP55762
2026-03-30 05:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with identifier: CP55762
2026-03-30 05:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6997c85-2dcd-5f5c-a1b9-9c65149a03d7 with identifier: CP55762 to the API
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'petrol',
 'id': 'f6997c85-2dcd-5f5c-a1b9-9c65149a03d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP55762',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 24054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-10',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.8 DOHC Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2009}
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Saving data for CP55762: {'auction_closing_time': 1774884528.0, 'created_time': 1773429132.152663, 'last_price_update_time': 1774849180.101818}
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP55762') HTTP/1.1" 204 0
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Scrape type for EY98011: 2
2026-03-30 05:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-30 05:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with scrape type 2
2026-03-30 05:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with scrape type 2
2026-03-30 05:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1, identifier: EY98011
2026-03-30 05:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-30 05:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011
2026-03-30 05:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1 with identifier: EY98011 to the API
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:33Z',
 'fuel_type': 'diesel',
 'id': 'f06b5da0-bbb5-5d07-9dcb-a83e4b350dd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY98011',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5 Cross Tourer',
 'odometer': 167091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-14',
 'seller_name': None,
 'title': 'Citroen C5 Cross Tourer 2.0 Blue-HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Saving data for EY98011: {'auction_closing_time': 1774883073.0, 'created_time': 1774550879.580074, 'last_price_update_time': 1774849180.628524}
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY98011') HTTP/1.1" 204 0
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Scrape type for MK93259: 0
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-30 05:39:40 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-30 05:39:40 [auto1.de] INFO: Scrape type for JT09686: 2
2026-03-30 05:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with identifier: JT09686
2026-03-30 05:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with scrape type 2
2026-03-30 05:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with scrape type 2
2026-03-30 05:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899, identifier: JT09686
2026-03-30 05:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with identifier: JT09686
2026-03-30 05:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with identifier: JT09686
2026-03-30 05:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32b6dd15-a4d5-51b0-8008-5f5ce9d9f899 with identifier: JT09686 to the API
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:03:32Z',
 'fuel_type': 'petrol',
 'id': '32b6dd15-a4d5-51b0-8008-5f5ce9d9f899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT09686',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 51619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-29',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2024}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Saving data for JT09686: {'auction_closing_time': 1774883012.0, 'created_time': 1774550097.243808, 'last_price_update_time': 1774849181.045248}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT09686') HTTP/1.1" 204 0
2026-03-30 05:39:41 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Scrape type for NS09930: 2
2026-03-30 05:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-30 05:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58a07fd-335a-57e8-95eb-284799fbaf25 with scrape type 2
2026-03-30 05:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c58a07fd-335a-57e8-95eb-284799fbaf25 with scrape type 2
2026-03-30 05:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c58a07fd-335a-57e8-95eb-284799fbaf25, identifier: NS09930
2026-03-30 05:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-30 05:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930
2026-03-30 05:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c58a07fd-335a-57e8-95eb-284799fbaf25 with identifier: NS09930 to the API
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:42Z',
 'fuel_type': 'petrol',
 'id': 'c58a07fd-335a-57e8-95eb-284799fbaf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS09930',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 80661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Saving data for NS09930: {'auction_closing_time': 1774885002.0, 'created_time': 1774553017.001279, 'last_price_update_time': 1774849181.563804}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS09930') HTTP/1.1" 204 0
2026-03-30 05:39:41 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:41 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Scrape type for NY21344: 0
2026-03-30 05:39:41 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-30 05:39:41 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-30 05:39:41 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Scrape type for CB40051: 2
2026-03-30 05:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d823f409-700a-54f4-87dd-5af08e53b267 with identifier: CB40051
2026-03-30 05:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d823f409-700a-54f4-87dd-5af08e53b267 with scrape type 2
2026-03-30 05:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d823f409-700a-54f4-87dd-5af08e53b267 with scrape type 2
2026-03-30 05:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d823f409-700a-54f4-87dd-5af08e53b267, identifier: CB40051
2026-03-30 05:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d823f409-700a-54f4-87dd-5af08e53b267 with identifier: CB40051
2026-03-30 05:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d823f409-700a-54f4-87dd-5af08e53b267 with identifier: CB40051
2026-03-30 05:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d823f409-700a-54f4-87dd-5af08e53b267 with identifier: CB40051 to the API
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:09Z',
 'fuel_type': 'diesel',
 'id': 'd823f409-700a-54f4-87dd-5af08e53b267',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB40051',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 251839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-14',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-30 05:39:41 [auto1.de] INFO: Saving data for CB40051: {'auction_closing_time': 1774885149.0, 'created_time': 1774549835.654409, 'last_price_update_time': 1774849181.98577}
2026-03-30 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB40051') HTTP/1.1" 204 0
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Scrape type for HB70808: 2
2026-03-30 05:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f6db64-6727-5627-a068-c6a062c26dcb with identifier: HB70808
2026-03-30 05:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f6db64-6727-5627-a068-c6a062c26dcb with scrape type 2
2026-03-30 05:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f6db64-6727-5627-a068-c6a062c26dcb with scrape type 2
2026-03-30 05:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3f6db64-6727-5627-a068-c6a062c26dcb, identifier: HB70808
2026-03-30 05:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3f6db64-6727-5627-a068-c6a062c26dcb with identifier: HB70808
2026-03-30 05:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3f6db64-6727-5627-a068-c6a062c26dcb with identifier: HB70808
2026-03-30 05:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3f6db64-6727-5627-a068-c6a062c26dcb with identifier: HB70808 to the API
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:25Z',
 'fuel_type': 'diesel',
 'id': 'f3f6db64-6727-5627-a068-c6a062c26dcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB70808',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 173493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-10',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Saving data for HB70808: {'auction_closing_time': 1774884145.0, 'created_time': 1774637473.077452, 'last_price_update_time': 1774849182.379684}
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB70808') HTTP/1.1" 204 0
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Scrape type for HL07149: 2
2026-03-30 05:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb39166f-c754-5433-9ec4-62b45ccfa571 with identifier: HL07149
2026-03-30 05:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb39166f-c754-5433-9ec4-62b45ccfa571 with scrape type 2
2026-03-30 05:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb39166f-c754-5433-9ec4-62b45ccfa571 with scrape type 2
2026-03-30 05:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb39166f-c754-5433-9ec4-62b45ccfa571, identifier: HL07149
2026-03-30 05:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb39166f-c754-5433-9ec4-62b45ccfa571 with identifier: HL07149
2026-03-30 05:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb39166f-c754-5433-9ec4-62b45ccfa571 with identifier: HL07149
2026-03-30 05:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb39166f-c754-5433-9ec4-62b45ccfa571 with identifier: HL07149 to the API
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:39Z',
 'fuel_type': 'petrol',
 'id': 'fb39166f-c754-5433-9ec4-62b45ccfa571',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL07149',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 95098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Saving data for HL07149: {'auction_closing_time': 1774884639.0, 'created_time': 1774637642.929303, 'last_price_update_time': 1774849182.811645}
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL07149') HTTP/1.1" 204 0
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-30 05:39:42 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-30 05:39:42 [auto1.de] INFO: Scrape type for LA11075: 2
2026-03-30 05:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67c3d9d5-09a5-52d2-a55f-c63857661222 with identifier: LA11075
2026-03-30 05:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67c3d9d5-09a5-52d2-a55f-c63857661222 with scrape type 2
2026-03-30 05:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67c3d9d5-09a5-52d2-a55f-c63857661222 with scrape type 2
2026-03-30 05:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67c3d9d5-09a5-52d2-a55f-c63857661222, identifier: LA11075
2026-03-30 05:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67c3d9d5-09a5-52d2-a55f-c63857661222 with identifier: LA11075
2026-03-30 05:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67c3d9d5-09a5-52d2-a55f-c63857661222 with identifier: LA11075
2026-03-30 05:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67c3d9d5-09a5-52d2-a55f-c63857661222 with identifier: LA11075 to the API
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:49Z',
 'fuel_type': 'diesel',
 'id': '67c3d9d5-09a5-52d2-a55f-c63857661222',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA11075',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 275195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Linje Svart',
 'transmission': 'automatic',
 'trim': 'Linje Svart',
 'year': 2016}
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-30 05:39:43 [auto1.de] INFO: Saving data for LA11075: {'auction_closing_time': 1774884829.0, 'created_time': 1774639282.994415, 'last_price_update_time': 1774849183.354404}
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA11075') HTTP/1.1" 204 0
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-30 05:39:43 [auto1.de] INFO: Scrape type for BX54451: 2
2026-03-30 05:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with identifier: BX54451
2026-03-30 05:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with scrape type 2
2026-03-30 05:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with scrape type 2
2026-03-30 05:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb, identifier: BX54451
2026-03-30 05:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with identifier: BX54451
2026-03-30 05:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with identifier: BX54451
2026-03-30 05:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb with identifier: BX54451 to the API
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:26:03Z',
 'fuel_type': 'petrol',
 'id': 'ed0724cd-ed2c-5a98-9d0a-ba18b0b9c3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX54451',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 176085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-12',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-30 05:39:43 [auto1.de] INFO: Saving data for BX54451: {'auction_closing_time': 1774884363.0, 'created_time': 1774639386.451801, 'last_price_update_time': 1774849183.765062}
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX54451') HTTP/1.1" 204 0
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-30 05:39:43 [auto1.de] INFO: Scrape type for KU93910: 0
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 05:39:43 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-30 05:39:43 [auto1.de] INFO: Scrape type for EC39473: 2
2026-03-30 05:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-30 05:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3e464e-613d-5d59-961b-a82012f2016b with scrape type 2
2026-03-30 05:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec3e464e-613d-5d59-961b-a82012f2016b with scrape type 2
2026-03-30 05:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec3e464e-613d-5d59-961b-a82012f2016b, identifier: EC39473
2026-03-30 05:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-30 05:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473
2026-03-30 05:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec3e464e-613d-5d59-961b-a82012f2016b with identifier: EC39473 to the API
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:24:23Z',
 'fuel_type': 'petrol',
 'id': 'ec3e464e-613d-5d59-961b-a82012f2016b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC39473',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Lancer',
 'odometer': 170662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-08',
 'seller_name': None,
 'title': 'Mitsubishi Lancer 1.6 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2015}
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-30 05:39:44 [auto1.de] INFO: Saving data for EC39473: {'auction_closing_time': 1774884263.0, 'created_time': 1774552092.673794, 'last_price_update_time': 1774849184.217904}
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC39473') HTTP/1.1" 204 0
2026-03-30 05:39:44 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-30 05:39:44 [auto1.de] INFO: Scrape type for BK24126: 2
2026-03-30 05:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1e00ffc-2a55-5215-8d9c-7aa32e047726 with identifier: BK24126
2026-03-30 05:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1e00ffc-2a55-5215-8d9c-7aa32e047726 with scrape type 2
2026-03-30 05:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1e00ffc-2a55-5215-8d9c-7aa32e047726 with scrape type 2
2026-03-30 05:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1e00ffc-2a55-5215-8d9c-7aa32e047726, identifier: BK24126
2026-03-30 05:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1e00ffc-2a55-5215-8d9c-7aa32e047726 with identifier: BK24126
2026-03-30 05:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1e00ffc-2a55-5215-8d9c-7aa32e047726 with identifier: BK24126
2026-03-30 05:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1e00ffc-2a55-5215-8d9c-7aa32e047726 with identifier: BK24126 to the API
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:25:35Z',
 'fuel_type': 'petrol',
 'id': 'a1e00ffc-2a55-5215-8d9c-7aa32e047726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK24126',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 91804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-30 05:39:44 [auto1.de] INFO: Saving data for BK24126: {'auction_closing_time': 1774884335.0, 'created_time': 1774637238.010738, 'last_price_update_time': 1774849184.728484}
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK24126') HTTP/1.1" 204 0
2026-03-30 05:39:44 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-30 05:39:44 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 05:39:44 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-30 05:39:44 [auto1.de] INFO: Scrape type for YK25344: 2
2026-03-30 05:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 341ba6a5-538b-59d3-be71-605271ecbef3 with identifier: YK25344
2026-03-30 05:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 341ba6a5-538b-59d3-be71-605271ecbef3 with scrape type 2
2026-03-30 05:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 341ba6a5-538b-59d3-be71-605271ecbef3 with scrape type 2
2026-03-30 05:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 341ba6a5-538b-59d3-be71-605271ecbef3, identifier: YK25344
2026-03-30 05:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 341ba6a5-538b-59d3-be71-605271ecbef3 with identifier: YK25344
2026-03-30 05:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 341ba6a5-538b-59d3-be71-605271ecbef3 with identifier: YK25344
2026-03-30 05:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 341ba6a5-538b-59d3-be71-605271ecbef3 with identifier: YK25344 to the API
2026-03-30 05:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:07:59Z',
 'fuel_type': 'petrol',
 'id': '341ba6a5-538b-59d3-be71-605271ecbef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK25344',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 149014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-10',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 Style Plus Edition',
 'transmission': 'manual',
 'trim': 'Style Plus Edition',
 'year': 2009}
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Saving data for YK25344: {'auction_closing_time': 1774883279.0, 'created_time': 1774638752.933109, 'last_price_update_time': 1774849185.120065}
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK25344') HTTP/1.1" 204 0
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Scrape type for UG59761: 2
2026-03-30 05:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2701f3e-c647-5b44-b154-5e42f7452c7b with identifier: UG59761
2026-03-30 05:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2701f3e-c647-5b44-b154-5e42f7452c7b with scrape type 2
2026-03-30 05:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2701f3e-c647-5b44-b154-5e42f7452c7b with scrape type 2
2026-03-30 05:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2701f3e-c647-5b44-b154-5e42f7452c7b, identifier: UG59761
2026-03-30 05:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2701f3e-c647-5b44-b154-5e42f7452c7b with identifier: UG59761
2026-03-30 05:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2701f3e-c647-5b44-b154-5e42f7452c7b with identifier: UG59761
2026-03-30 05:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2701f3e-c647-5b44-b154-5e42f7452c7b with identifier: UG59761 to the API
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:25Z',
 'fuel_type': 'petrol',
 'id': 'c2701f3e-c647-5b44-b154-5e42f7452c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG59761',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 56500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Saving data for UG59761: {'auction_closing_time': 1774884385.0, 'created_time': 1773945960.789133, 'last_price_update_time': 1774849185.531902}
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG59761') HTTP/1.1" 204 0
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-30 05:39:45 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-30 05:39:45 [auto1.de] INFO: Scrape type for XU92987: 2
2026-03-30 05:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4832ebfd-60f1-58b9-a358-53e6b871aa10 with identifier: XU92987
2026-03-30 05:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4832ebfd-60f1-58b9-a358-53e6b871aa10 with scrape type 2
2026-03-30 05:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4832ebfd-60f1-58b9-a358-53e6b871aa10 with scrape type 2
2026-03-30 05:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4832ebfd-60f1-58b9-a358-53e6b871aa10, identifier: XU92987
2026-03-30 05:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4832ebfd-60f1-58b9-a358-53e6b871aa10 with identifier: XU92987
2026-03-30 05:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4832ebfd-60f1-58b9-a358-53e6b871aa10 with identifier: XU92987
2026-03-30 05:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4832ebfd-60f1-58b9-a358-53e6b871aa10 with identifier: XU92987 to the API
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:14:30Z',
 'fuel_type': 'petrol',
 'id': '4832ebfd-60f1-58b9-a358-53e6b871aa10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU92987',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 119016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-29',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Turbo Beats Edition',
 'transmission': 'manual',
 'trim': 'Beats Edition',
 'year': 2014}
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-30 05:39:46 [auto1.de] INFO: Saving data for XU92987: {'auction_closing_time': 1774883670.0, 'created_time': 1774638757.376114, 'last_price_update_time': 1774849186.045159}
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU92987') HTTP/1.1" 204 0
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 05:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:46 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-30 05:39:46 [auto1.de] INFO: Scrape type for MU36572: 2
2026-03-30 05:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e86ff82-f2ad-5723-8f79-0548f1aff19a with identifier: MU36572
2026-03-30 05:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e86ff82-f2ad-5723-8f79-0548f1aff19a with scrape type 2
2026-03-30 05:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e86ff82-f2ad-5723-8f79-0548f1aff19a with scrape type 2
2026-03-30 05:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e86ff82-f2ad-5723-8f79-0548f1aff19a, identifier: MU36572
2026-03-30 05:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e86ff82-f2ad-5723-8f79-0548f1aff19a with identifier: MU36572
2026-03-30 05:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e86ff82-f2ad-5723-8f79-0548f1aff19a with identifier: MU36572
2026-03-30 05:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e86ff82-f2ad-5723-8f79-0548f1aff19a with identifier: MU36572 to the API
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:50:22Z',
 'fuel_type': 'diesel',
 'id': '2e86ff82-f2ad-5723-8f79-0548f1aff19a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU36572',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 153550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-11-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2001}
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-30 05:39:46 [auto1.de] INFO: Saving data for MU36572: {'auction_closing_time': 1774885822.0, 'created_time': 1774639160.669008, 'last_price_update_time': 1774849186.661259}
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU36572') HTTP/1.1" 204 0
2026-03-30 05:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:46 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-30 05:39:46 [auto1.de] INFO: Scrape type for EE74949: 2
2026-03-30 05:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-30 05:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with scrape type 2
2026-03-30 05:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with scrape type 2
2026-03-30 05:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf16192a-aca0-53cc-bbf1-9e9aa93aa224, identifier: EE74949
2026-03-30 05:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-30 05:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949
2026-03-30 05:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf16192a-aca0-53cc-bbf1-9e9aa93aa224 with identifier: EE74949 to the API
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:35Z',
 'fuel_type': 'diesel',
 'id': 'cf16192a-aca0-53cc-bbf1-9e9aa93aa224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE74949',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 121036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-18',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2018}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Saving data for EE74949: {'auction_closing_time': 1774884935.0, 'created_time': 1774552553.055673, 'last_price_update_time': 1774849187.063525}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE74949') HTTP/1.1" 204 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for AP20693: 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for YT56915: 2
2026-03-30 05:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-30 05:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with scrape type 2
2026-03-30 05:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with scrape type 2
2026-03-30 05:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5, identifier: YT56915
2026-03-30 05:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-30 05:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915
2026-03-30 05:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c3a4ac7-72dd-5a38-a36e-7d9396be73e5 with identifier: YT56915 to the API
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:40:00Z',
 'fuel_type': 'petrol',
 'id': '6c3a4ac7-72dd-5a38-a36e-7d9396be73e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT56915',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 145425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2011}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Saving data for YT56915: {'auction_closing_time': 1774885200.0, 'created_time': 1774589445.571612, 'last_price_update_time': 1774849187.484128}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT56915') HTTP/1.1" 204 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for ZK07522: 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: US61717
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-30 05:39:47 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Scrape type for SG08144: 2
2026-03-30 05:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with identifier: SG08144
2026-03-30 05:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with scrape type 2
2026-03-30 05:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with scrape type 2
2026-03-30 05:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92, identifier: SG08144
2026-03-30 05:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with identifier: SG08144
2026-03-30 05:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with identifier: SG08144
2026-03-30 05:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b9b015e-18f7-51d1-9dc8-0ac4a1246f92 with identifier: SG08144 to the API
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:44:02Z',
 'fuel_type': 'diesel',
 'id': '0b9b015e-18f7-51d1-9dc8-0ac4a1246f92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG08144',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 107304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2018}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-30 05:39:47 [auto1.de] INFO: Saving data for SG08144: {'auction_closing_time': 1774885442.0, 'created_time': 1774637540.736787, 'last_price_update_time': 1774849187.942617}
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG08144') HTTP/1.1" 204 0
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Scrape type for UJ63993: 2
2026-03-30 05:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10dc65f-a72e-5ece-8282-7512bb9b81d4 with identifier: UJ63993
2026-03-30 05:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10dc65f-a72e-5ece-8282-7512bb9b81d4 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10dc65f-a72e-5ece-8282-7512bb9b81d4 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d10dc65f-a72e-5ece-8282-7512bb9b81d4, identifier: UJ63993
2026-03-30 05:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d10dc65f-a72e-5ece-8282-7512bb9b81d4 with identifier: UJ63993
2026-03-30 05:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d10dc65f-a72e-5ece-8282-7512bb9b81d4 with identifier: UJ63993
2026-03-30 05:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d10dc65f-a72e-5ece-8282-7512bb9b81d4 with identifier: UJ63993 to the API
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:33:13Z',
 'fuel_type': 'petrol',
 'id': 'd10dc65f-a72e-5ece-8282-7512bb9b81d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ63993',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai+2',
 'odometer': 130440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-08',
 'seller_name': None,
 'title': 'Nissan Qashqai+2 2.0 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Saving data for UJ63993: {'auction_closing_time': 1774884793.0, 'created_time': 1774639035.312324, 'last_price_update_time': 1774849188.456521}
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ63993') HTTP/1.1" 204 0
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Scrape type for XP10598: 0
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Scrape type for PJ27093: 2
2026-03-30 05:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with identifier: PJ27093
2026-03-30 05:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fc93efe-1933-5c3b-9c9c-f44a620b4820, identifier: PJ27093
2026-03-30 05:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with identifier: PJ27093
2026-03-30 05:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with identifier: PJ27093
2026-03-30 05:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fc93efe-1933-5c3b-9c9c-f44a620b4820 with identifier: PJ27093 to the API
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:35:31Z',
 'fuel_type': 'petrol',
 'id': '8fc93efe-1933-5c3b-9c9c-f44a620b4820',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ27093',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 120659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-12',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 300',
 'transmission': 'automatic',
 'trim': 'Cupra 300',
 'year': 2018}
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Saving data for PJ27093: {'auction_closing_time': 1774884931.0, 'created_time': 1773945615.756786, 'last_price_update_time': 1774849188.857555}
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ27093') HTTP/1.1" 204 0
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 05:39:48 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-30 05:39:48 [auto1.de] INFO: Scrape type for FM49388: 2
2026-03-30 05:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-30 05:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09264a1a-33a6-5933-b4e7-2a60cdca7418 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09264a1a-33a6-5933-b4e7-2a60cdca7418 with scrape type 2
2026-03-30 05:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09264a1a-33a6-5933-b4e7-2a60cdca7418, identifier: FM49388
2026-03-30 05:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-30 05:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388
2026-03-30 05:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09264a1a-33a6-5933-b4e7-2a60cdca7418 with identifier: FM49388 to the API
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'diesel',
 'id': '09264a1a-33a6-5933-b4e7-2a60cdca7418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM49388',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 232922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-30 05:39:49 [auto1.de] INFO: Saving data for FM49388: {'auction_closing_time': 1774883705.0, 'created_time': 1774550496.424591, 'last_price_update_time': 1774849189.259569}
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM49388') HTTP/1.1" 204 0
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-30 05:39:49 [auto1.de] INFO: Scrape type for DA76775: 2
2026-03-30 05:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with identifier: DA76775
2026-03-30 05:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with scrape type 2
2026-03-30 05:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with scrape type 2
2026-03-30 05:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808, identifier: DA76775
2026-03-30 05:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with identifier: DA76775
2026-03-30 05:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with identifier: DA76775
2026-03-30 05:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808 with identifier: DA76775 to the API
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:35:57Z',
 'fuel_type': 'petrol',
 'id': 'd5671cf8-dcc1-53f8-9f9c-fd6b7b0cb808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA76775',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 120057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-12',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-30 05:39:49 [auto1.de] INFO: Saving data for DA76775: {'auction_closing_time': 1774884957.0, 'created_time': 1774637129.72253, 'last_price_update_time': 1774849189.666056}
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA76775') HTTP/1.1" 204 0
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-30 05:39:49 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-30 05:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:49 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:49 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-30 05:39:49 [auto1.de] INFO: Scrape type for ET45765: 2
2026-03-30 05:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with identifier: ET45765
2026-03-30 05:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with scrape type 2
2026-03-30 05:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with scrape type 2
2026-03-30 05:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a913577-a0f9-5b9c-b0ac-aed22aec75ab, identifier: ET45765
2026-03-30 05:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with identifier: ET45765
2026-03-30 05:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with identifier: ET45765
2026-03-30 05:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a913577-a0f9-5b9c-b0ac-aed22aec75ab with identifier: ET45765 to the API
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:36:46Z',
 'fuel_type': 'petrol',
 'id': '0a913577-a0f9-5b9c-b0ac-aed22aec75ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET45765',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 151738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-25',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Quadrifoglio Verde',
 'transmission': 'automatic',
 'trim': 'Quadrifoglio Verde',
 'year': 2016}
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Saving data for ET45765: {'auction_closing_time': 1774885006.0, 'created_time': 1773342074.179138, 'last_price_update_time': 1774849190.295594}
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET45765') HTTP/1.1" 204 0
2026-03-30 05:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for RX80532: 2
2026-03-30 05:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c059a9f3-8b3f-524d-bb2d-25c929e95135 with identifier: RX80532
2026-03-30 05:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c059a9f3-8b3f-524d-bb2d-25c929e95135 with scrape type 2
2026-03-30 05:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c059a9f3-8b3f-524d-bb2d-25c929e95135 with scrape type 2
2026-03-30 05:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c059a9f3-8b3f-524d-bb2d-25c929e95135, identifier: RX80532
2026-03-30 05:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c059a9f3-8b3f-524d-bb2d-25c929e95135 with identifier: RX80532
2026-03-30 05:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c059a9f3-8b3f-524d-bb2d-25c929e95135 with identifier: RX80532
2026-03-30 05:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c059a9f3-8b3f-524d-bb2d-25c929e95135 with identifier: RX80532 to the API
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': 'c059a9f3-8b3f-524d-bb2d-25c929e95135',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX80532',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 80823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-23',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi EcoBlue ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Saving data for RX80532: {'auction_closing_time': 1774884104.0, 'created_time': 1774637671.795402, 'last_price_update_time': 1774849190.693433}
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX80532') HTTP/1.1" 204 0
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for SB35470: 0
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-30 05:39:50 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-30 05:39:50 [auto1.de] INFO: Scrape type for FD74109: 2
2026-03-30 05:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-30 05:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with scrape type 2
2026-03-30 05:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with scrape type 2
2026-03-30 05:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b6d1112-d52a-5da6-bd3a-91c1d9098432, identifier: FD74109
2026-03-30 05:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-30 05:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109
2026-03-30 05:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b6d1112-d52a-5da6-bd3a-91c1d9098432 with identifier: FD74109 to the API
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:10Z',
 'fuel_type': 'petrol',
 'id': '1b6d1112-d52a-5da6-bd3a-91c1d9098432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD74109',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 172917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-04',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 2.0 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2005}
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-30 05:39:51 [auto1.de] INFO: Saving data for FD74109: {'auction_closing_time': 1774885210.0, 'created_time': 1774550117.511419, 'last_price_update_time': 1774849191.248652}
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD74109') HTTP/1.1" 204 0
2026-03-30 05:39:51 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-30 05:39:51 [auto1.de] INFO: Scrape type for XS48010: 2
2026-03-30 05:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6633cf9e-6edc-532b-b522-fba4c12a44bd with identifier: XS48010
2026-03-30 05:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6633cf9e-6edc-532b-b522-fba4c12a44bd with scrape type 2
2026-03-30 05:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6633cf9e-6edc-532b-b522-fba4c12a44bd with scrape type 2
2026-03-30 05:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6633cf9e-6edc-532b-b522-fba4c12a44bd, identifier: XS48010
2026-03-30 05:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6633cf9e-6edc-532b-b522-fba4c12a44bd with identifier: XS48010
2026-03-30 05:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6633cf9e-6edc-532b-b522-fba4c12a44bd with identifier: XS48010
2026-03-30 05:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6633cf9e-6edc-532b-b522-fba4c12a44bd with identifier: XS48010 to the API
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:45Z',
 'fuel_type': 'petrol',
 'id': '6633cf9e-6edc-532b-b522-fba4c12a44bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS48010',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 138457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-30 05:39:51 [auto1.de] INFO: Saving data for XS48010: {'auction_closing_time': 1774883745.0, 'created_time': 1773945613.17731, 'last_price_update_time': 1774849191.64088}
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS48010') HTTP/1.1" 204 0
2026-03-30 05:39:51 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-30 05:39:51 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-30 05:39:51 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 05:39:51 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 05:39:51 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-30 05:39:51 [auto1.de] INFO: Scrape type for CC98998: 2
2026-03-30 05:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 065dfdb3-6f47-5ee8-adcd-17ee4857685f with identifier: CC98998
2026-03-30 05:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 065dfdb3-6f47-5ee8-adcd-17ee4857685f with scrape type 2
2026-03-30 05:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 065dfdb3-6f47-5ee8-adcd-17ee4857685f with scrape type 2
2026-03-30 05:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 065dfdb3-6f47-5ee8-adcd-17ee4857685f, identifier: CC98998
2026-03-30 05:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 065dfdb3-6f47-5ee8-adcd-17ee4857685f with identifier: CC98998
2026-03-30 05:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 065dfdb3-6f47-5ee8-adcd-17ee4857685f with identifier: CC98998
2026-03-30 05:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 065dfdb3-6f47-5ee8-adcd-17ee4857685f with identifier: CC98998 to the API
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': '065dfdb3-6f47-5ee8-adcd-17ee4857685f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC98998',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 133012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2017}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-30 05:39:52 [auto1.de] INFO: Saving data for CC98998: {'auction_closing_time': 1774884562.0, 'created_time': 1774639439.833851, 'last_price_update_time': 1774849192.052124}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC98998') HTTP/1.1" 204 0
2026-03-30 05:39:52 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-30 05:39:52 [auto1.de] INFO: Scrape type for XK50877: 2
2026-03-30 05:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-30 05:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with scrape type 2
2026-03-30 05:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with scrape type 2
2026-03-30 05:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85, identifier: XK50877
2026-03-30 05:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-30 05:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877
2026-03-30 05:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ea2a3e-64db-5f90-82fe-aa3178eb4a85 with identifier: XK50877 to the API
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:01:44Z',
 'fuel_type': 'petrol',
 'id': '20ea2a3e-64db-5f90-82fe-aa3178eb4a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK50877',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 76862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 290',
 'transmission': 'automatic',
 'trim': 'Cupra 290',
 'year': 2019}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-30 05:39:52 [auto1.de] INFO: Saving data for XK50877: {'auction_closing_time': 1774882904.0, 'created_time': 1773945871.386987, 'last_price_update_time': 1774849192.545351}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK50877') HTTP/1.1" 204 0
2026-03-30 05:39:52 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-30 05:39:52 [auto1.de] INFO: Scrape type for TK89149: 2
2026-03-30 05:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486d1b6f-301f-5372-a9ef-794052dea0aa with identifier: TK89149
2026-03-30 05:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486d1b6f-301f-5372-a9ef-794052dea0aa with scrape type 2
2026-03-30 05:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486d1b6f-301f-5372-a9ef-794052dea0aa with scrape type 2
2026-03-30 05:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 486d1b6f-301f-5372-a9ef-794052dea0aa, identifier: TK89149
2026-03-30 05:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 486d1b6f-301f-5372-a9ef-794052dea0aa with identifier: TK89149
2026-03-30 05:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 486d1b6f-301f-5372-a9ef-794052dea0aa with identifier: TK89149
2026-03-30 05:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 486d1b6f-301f-5372-a9ef-794052dea0aa with identifier: TK89149 to the API
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:56Z',
 'fuel_type': 'diesel',
 'id': '486d1b6f-301f-5372-a9ef-794052dea0aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK89149',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 186702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2011}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-30 05:39:52 [auto1.de] INFO: Saving data for TK89149: {'auction_closing_time': 1774886156.0, 'created_time': 1773229767.714794, 'last_price_update_time': 1774849192.966751}
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK89149') HTTP/1.1" 204 0
2026-03-30 05:39:52 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 05:39:52 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for TA61960: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for UX47002: 2
2026-03-30 05:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-30 05:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 827f7340-56cf-5d45-9733-eec472918284 with scrape type 2
2026-03-30 05:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 827f7340-56cf-5d45-9733-eec472918284 with scrape type 2
2026-03-30 05:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 827f7340-56cf-5d45-9733-eec472918284, identifier: UX47002
2026-03-30 05:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-30 05:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002
2026-03-30 05:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 827f7340-56cf-5d45-9733-eec472918284 with identifier: UX47002 to the API
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:41:03Z',
 'fuel_type': 'petrol',
 'id': '827f7340-56cf-5d45-9733-eec472918284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX47002',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 159862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Saving data for UX47002: {'auction_closing_time': 1774885263.0, 'created_time': 1774550645.788911, 'last_price_update_time': 1774849193.453148}
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX47002') HTTP/1.1" 204 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-30 05:39:53 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Scrape type for WL10604: 2
2026-03-30 05:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-30 05:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c49af2ac-2335-5f67-9183-7fb3fb493cfd with scrape type 2
2026-03-30 05:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c49af2ac-2335-5f67-9183-7fb3fb493cfd with scrape type 2
2026-03-30 05:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c49af2ac-2335-5f67-9183-7fb3fb493cfd, identifier: WL10604
2026-03-30 05:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-30 05:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604
2026-03-30 05:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c49af2ac-2335-5f67-9183-7fb3fb493cfd with identifier: WL10604 to the API
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'petrol',
 'id': 'c49af2ac-2335-5f67-9183-7fb3fb493cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL10604',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 137581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 DSi LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2006}
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-30 05:39:53 [auto1.de] INFO: Saving data for WL10604: {'auction_closing_time': 1774886316.0, 'created_time': 1774551855.364848, 'last_price_update_time': 1774849193.910041}
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL10604') HTTP/1.1" 204 0
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Scrape type for SZ10404: 0
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Scrape type for PX47030: 2
2026-03-30 05:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-30 05:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4abea932-9320-5b89-8001-dcef59e7e5e4 with scrape type 2
2026-03-30 05:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4abea932-9320-5b89-8001-dcef59e7e5e4 with scrape type 2
2026-03-30 05:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4abea932-9320-5b89-8001-dcef59e7e5e4, identifier: PX47030
2026-03-30 05:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-30 05:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030
2026-03-30 05:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4abea932-9320-5b89-8001-dcef59e7e5e4 with identifier: PX47030 to the API
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:31:55Z',
 'fuel_type': 'petrol',
 'id': '4abea932-9320-5b89-8001-dcef59e7e5e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX47030',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 169752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Saving data for PX47030: {'auction_closing_time': 1774884715.0, 'created_time': 1774552563.881598, 'last_price_update_time': 1774849194.482982}
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX47030') HTTP/1.1" 204 0
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Scrape type for YP93259: 2
2026-03-30 05:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac416626-090c-522b-938e-24b4bbc87ab3 with identifier: YP93259
2026-03-30 05:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac416626-090c-522b-938e-24b4bbc87ab3 with scrape type 2
2026-03-30 05:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac416626-090c-522b-938e-24b4bbc87ab3 with scrape type 2
2026-03-30 05:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac416626-090c-522b-938e-24b4bbc87ab3, identifier: YP93259
2026-03-30 05:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac416626-090c-522b-938e-24b4bbc87ab3 with identifier: YP93259
2026-03-30 05:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac416626-090c-522b-938e-24b4bbc87ab3 with identifier: YP93259
2026-03-30 05:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac416626-090c-522b-938e-24b4bbc87ab3 with identifier: YP93259 to the API
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:31Z',
 'fuel_type': 'diesel',
 'id': 'ac416626-090c-522b-938e-24b4bbc87ab3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP93259',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 233608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d 4MATIC lang',
 'transmission': 'automatic',
 'trim': '4MATIC lang',
 'year': 2021}
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Saving data for YP93259: {'auction_closing_time': 1774884331.0, 'created_time': 1773227536.04823, 'last_price_update_time': 1774849194.883059}
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP93259') HTTP/1.1" 204 0
2026-03-30 05:39:54 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-30 05:39:54 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-30 05:39:54 [auto1.de] INFO: Scrape type for KW72669: 2
2026-03-30 05:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-30 05:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f763cab5-8f32-58ef-8fc1-f9ae77ae991f with scrape type 2
2026-03-30 05:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f763cab5-8f32-58ef-8fc1-f9ae77ae991f with scrape type 2
2026-03-30 05:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f763cab5-8f32-58ef-8fc1-f9ae77ae991f, identifier: KW72669
2026-03-30 05:39:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-30 05:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669
2026-03-30 05:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f763cab5-8f32-58ef-8fc1-f9ae77ae991f with identifier: KW72669 to the API
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'diesel',
 'id': 'f763cab5-8f32-58ef-8fc1-f9ae77ae991f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW72669',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 170592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2017}
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Saving data for KW72669: {'auction_closing_time': 1774885194.0, 'created_time': 1774436000.599067, 'last_price_update_time': 1774849195.278104}
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW72669') HTTP/1.1" 204 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for MP44977: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for AW26108: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for EE70879: 2
2026-03-30 05:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f56a077-215e-5072-bda2-2d4301161b85 with identifier: EE70879
2026-03-30 05:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f56a077-215e-5072-bda2-2d4301161b85 with scrape type 2
2026-03-30 05:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f56a077-215e-5072-bda2-2d4301161b85 with scrape type 2
2026-03-30 05:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f56a077-215e-5072-bda2-2d4301161b85, identifier: EE70879
2026-03-30 05:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f56a077-215e-5072-bda2-2d4301161b85 with identifier: EE70879
2026-03-30 05:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f56a077-215e-5072-bda2-2d4301161b85 with identifier: EE70879
2026-03-30 05:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f56a077-215e-5072-bda2-2d4301161b85 with identifier: EE70879 to the API
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:37:46Z',
 'fuel_type': 'diesel',
 'id': '4f56a077-215e-5072-bda2-2d4301161b85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE70879',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 210753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 e-HDi Intensive',
 'transmission': 'manual',
 'trim': 'Intensive',
 'year': 2014}
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Saving data for EE70879: {'auction_closing_time': 1774885066.0, 'created_time': 1774031968.663126, 'last_price_update_time': 1774849195.777279}
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE70879') HTTP/1.1" 204 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for LJ68235: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-30 05:39:55 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-30 05:39:55 [auto1.de] INFO: Scrape type for KX24569: 2
2026-03-30 05:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88649754-a4ef-52cf-aa55-e69c96263a6d with identifier: KX24569
2026-03-30 05:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88649754-a4ef-52cf-aa55-e69c96263a6d with scrape type 2
2026-03-30 05:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88649754-a4ef-52cf-aa55-e69c96263a6d with scrape type 2
2026-03-30 05:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88649754-a4ef-52cf-aa55-e69c96263a6d, identifier: KX24569
2026-03-30 05:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88649754-a4ef-52cf-aa55-e69c96263a6d with identifier: KX24569
2026-03-30 05:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88649754-a4ef-52cf-aa55-e69c96263a6d with identifier: KX24569
2026-03-30 05:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88649754-a4ef-52cf-aa55-e69c96263a6d with identifier: KX24569 to the API
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'petrol',
 'id': '88649754-a4ef-52cf-aa55-e69c96263a6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX24569',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 69253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.8 Turbo Veloce',
 'transmission': 'automatic',
 'trim': 'Veloce',
 'year': 2019}
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Saving data for KX24569: {'auction_closing_time': 1774884813.0, 'created_time': 1774637962.985309, 'last_price_update_time': 1774849196.304633}
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX24569') HTTP/1.1" 204 0
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Scrape type for VR66334: 2
2026-03-30 05:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-30 05:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e023ed36-ac75-5635-8dbc-6190987645b5 with scrape type 2
2026-03-30 05:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e023ed36-ac75-5635-8dbc-6190987645b5 with scrape type 2
2026-03-30 05:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e023ed36-ac75-5635-8dbc-6190987645b5, identifier: VR66334
2026-03-30 05:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-30 05:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334
2026-03-30 05:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e023ed36-ac75-5635-8dbc-6190987645b5 with identifier: VR66334 to the API
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:43Z',
 'fuel_type': 'diesel',
 'id': 'e023ed36-ac75-5635-8dbc-6190987645b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR66334',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 164553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Saving data for VR66334: {'auction_closing_time': 1774886383.0, 'created_time': 1774551865.827856, 'last_price_update_time': 1774849196.725159}
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR66334') HTTP/1.1" 204 0
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Scrape type for WV19329: 0
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 05:39:56 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-30 05:39:56 [auto1.de] INFO: Scrape type for EJ12041: 2
2026-03-30 05:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-30 05:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with scrape type 2
2026-03-30 05:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with scrape type 2
2026-03-30 05:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c, identifier: EJ12041
2026-03-30 05:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-30 05:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041
2026-03-30 05:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f9d3ce-86ed-5e95-b10d-cc1579e8142c with identifier: EJ12041 to the API
2026-03-30 05:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:24Z',
 'fuel_type': 'petrol',
 'id': 'c2f9d3ce-86ed-5e95-b10d-cc1579e8142c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ12041',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 22243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2024}
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-30 05:39:57 [auto1.de] INFO: Saving data for EJ12041: {'auction_closing_time': 1774885464.0, 'created_time': 1774552764.733147, 'last_price_update_time': 1774849197.142573}
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ12041') HTTP/1.1" 204 0
2026-03-30 05:39:57 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-30 05:39:57 [auto1.de] INFO: Scrape type for WW55400: 2
2026-03-30 05:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-30 05:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with scrape type 2
2026-03-30 05:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with scrape type 2
2026-03-30 05:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b, identifier: WW55400
2026-03-30 05:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-30 05:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400
2026-03-30 05:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b with identifier: WW55400 to the API
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:41:50Z',
 'fuel_type': 'diesel',
 'id': 'e64b9bc8-a2cd-5e1f-bb7b-257e1f0a7d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW55400',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 241037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-12',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-30 05:39:57 [auto1.de] INFO: Saving data for WW55400: {'auction_closing_time': 1774885310.0, 'created_time': 1774552121.220486, 'last_price_update_time': 1774849197.64786}
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW55400') HTTP/1.1" 204 0
2026-03-30 05:39:57 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-30 05:39:57 [auto1.de] INFO: Scrape type for KA83154: 2
2026-03-30 05:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12fc989-a55e-57b6-9229-076fda7d9e4d with identifier: KA83154
2026-03-30 05:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12fc989-a55e-57b6-9229-076fda7d9e4d with scrape type 2
2026-03-30 05:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12fc989-a55e-57b6-9229-076fda7d9e4d with scrape type 2
2026-03-30 05:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d12fc989-a55e-57b6-9229-076fda7d9e4d, identifier: KA83154
2026-03-30 05:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d12fc989-a55e-57b6-9229-076fda7d9e4d with identifier: KA83154
2026-03-30 05:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d12fc989-a55e-57b6-9229-076fda7d9e4d with identifier: KA83154
2026-03-30 05:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d12fc989-a55e-57b6-9229-076fda7d9e4d with identifier: KA83154 to the API
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:47Z',
 'fuel_type': 'petrol',
 'id': 'd12fc989-a55e-57b6-9229-076fda7d9e4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA83154',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 176587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-10',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 Style+',
 'transmission': 'manual',
 'trim': 'Style+',
 'year': 2010}
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Saving data for KA83154: {'auction_closing_time': 1774885307.0, 'created_time': 1774637124.45485, 'last_price_update_time': 1774849198.043117}
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA83154') HTTP/1.1" 204 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for EU38402: 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Scrape type for CV00012: 2
2026-03-30 05:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1161b977-93a2-5500-9077-c350524995d6 with identifier: CV00012
2026-03-30 05:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1161b977-93a2-5500-9077-c350524995d6 with scrape type 2
2026-03-30 05:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1161b977-93a2-5500-9077-c350524995d6 with scrape type 2
2026-03-30 05:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1161b977-93a2-5500-9077-c350524995d6, identifier: CV00012
2026-03-30 05:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1161b977-93a2-5500-9077-c350524995d6 with identifier: CV00012
2026-03-30 05:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1161b977-93a2-5500-9077-c350524995d6 with identifier: CV00012
2026-03-30 05:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1161b977-93a2-5500-9077-c350524995d6 with identifier: CV00012 to the API
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:58Z',
 'fuel_type': 'diesel',
 'id': '1161b977-93a2-5500-9077-c350524995d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV00012',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 185190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-17',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.8 DI-D Intense 4WD',
 'transmission': 'manual',
 'trim': 'Intense 4WD',
 'year': 2014}
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-30 05:39:58 [auto1.de] INFO: Saving data for CV00012: {'auction_closing_time': 1774883998.0, 'created_time': 1774638970.188446, 'last_price_update_time': 1774849198.525142}
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV00012') HTTP/1.1" 204 0
2026-03-30 05:39:58 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 05:39:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:39:59 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6742 | hits on page: 40
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for WD76267: 2
2026-03-30 05:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with identifier: WD76267
2026-03-30 05:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with scrape type 2
2026-03-30 05:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with scrape type 2
2026-03-30 05:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 638c7ca6-caec-5861-89cd-b1ce3e7d8619, identifier: WD76267
2026-03-30 05:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with identifier: WD76267
2026-03-30 05:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with identifier: WD76267
2026-03-30 05:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 638c7ca6-caec-5861-89cd-b1ce3e7d8619 with identifier: WD76267 to the API
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'petrol',
 'id': '638c7ca6-caec-5861-89cd-b1ce3e7d8619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD76267',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 136789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-23',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.6 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2013}
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Saving data for WD76267: {'auction_closing_time': 1774885795.0, 'created_time': 1773428147.251946, 'last_price_update_time': 1774849199.49166}
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD76267') HTTP/1.1" 204 0
2026-03-30 05:39:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for WF46634: 2
2026-03-30 05:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5da4673-bc32-5350-bb41-7a9b7ce9d062 with identifier: WF46634
2026-03-30 05:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5da4673-bc32-5350-bb41-7a9b7ce9d062 with scrape type 2
2026-03-30 05:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5da4673-bc32-5350-bb41-7a9b7ce9d062 with scrape type 2
2026-03-30 05:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5da4673-bc32-5350-bb41-7a9b7ce9d062, identifier: WF46634
2026-03-30 05:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5da4673-bc32-5350-bb41-7a9b7ce9d062 with identifier: WF46634
2026-03-30 05:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5da4673-bc32-5350-bb41-7a9b7ce9d062 with identifier: WF46634
2026-03-30 05:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5da4673-bc32-5350-bb41-7a9b7ce9d062 with identifier: WF46634 to the API
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'petrol',
 'id': 'b5da4673-bc32-5350-bb41-7a9b7ce9d062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF46634',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 195718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Saving data for WF46634: {'auction_closing_time': 1774883625.0, 'created_time': 1774349629.187322, 'last_price_update_time': 1774849199.900927}
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF46634') HTTP/1.1" 204 0
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for JY20186: 0
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-30 05:39:59 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-30 05:39:59 [auto1.de] INFO: Scrape type for BV96832: 2
2026-03-30 05:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-30 05:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61043bb6-83a5-5517-aca8-e5073aae6ced with scrape type 2
2026-03-30 05:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61043bb6-83a5-5517-aca8-e5073aae6ced with scrape type 2
2026-03-30 05:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61043bb6-83a5-5517-aca8-e5073aae6ced, identifier: BV96832
2026-03-30 05:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-30 05:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832
2026-03-30 05:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61043bb6-83a5-5517-aca8-e5073aae6ced with identifier: BV96832 to the API
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:48:40Z',
 'fuel_type': 'diesel',
 'id': '61043bb6-83a5-5517-aca8-e5073aae6ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV96832',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 191657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-22',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 116 CDI Extralang',
 'transmission': 'automatic',
 'trim': 'Extralang',
 'year': 2014}
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Saving data for BV96832: {'auction_closing_time': 1774885720.0, 'created_time': 1774589437.287928, 'last_price_update_time': 1774849200.379353}
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV96832') HTTP/1.1" 204 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for GJ77265: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for PS45422: 2
2026-03-30 05:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with identifier: PS45422
2026-03-30 05:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with scrape type 2
2026-03-30 05:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with scrape type 2
2026-03-30 05:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7, identifier: PS45422
2026-03-30 05:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with identifier: PS45422
2026-03-30 05:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with identifier: PS45422
2026-03-30 05:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dc0c736-17d1-5eae-b1ea-e72f7dc360f7 with identifier: PS45422 to the API
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:49Z',
 'fuel_type': 'diesel',
 'id': '3dc0c736-17d1-5eae-b1ea-e72f7dc360f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS45422',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 244274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-10',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2013}
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Saving data for PS45422: {'auction_closing_time': 1774883449.0, 'created_time': 1774639104.656215, 'last_price_update_time': 1774849200.93149}
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS45422') HTTP/1.1" 204 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for GX75432: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-30 05:40:00 [auto1.de] INFO: Scrape type for YA96721: 0
2026-03-30 05:40:00 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for WC63279: 2
2026-03-30 05:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with identifier: WC63279
2026-03-30 05:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with scrape type 2
2026-03-30 05:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with scrape type 2
2026-03-30 05:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95ed93d0-6565-5e4c-8eee-dbd18aee43f4, identifier: WC63279
2026-03-30 05:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with identifier: WC63279
2026-03-30 05:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with identifier: WC63279
2026-03-30 05:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95ed93d0-6565-5e4c-8eee-dbd18aee43f4 with identifier: WC63279 to the API
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:28Z',
 'fuel_type': 'diesel',
 'id': '95ed93d0-6565-5e4c-8eee-dbd18aee43f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63279',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 265869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Saving data for WC63279: {'auction_closing_time': 1774885888.0, 'created_time': 1774349468.567085, 'last_price_update_time': 1774849201.416951}
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC63279') HTTP/1.1" 204 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for CE80644: 2
2026-03-30 05:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bc20db7-3ed0-5140-9211-4aa023214206 with identifier: CE80644
2026-03-30 05:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bc20db7-3ed0-5140-9211-4aa023214206 with scrape type 2
2026-03-30 05:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bc20db7-3ed0-5140-9211-4aa023214206 with scrape type 2
2026-03-30 05:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bc20db7-3ed0-5140-9211-4aa023214206, identifier: CE80644
2026-03-30 05:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bc20db7-3ed0-5140-9211-4aa023214206 with identifier: CE80644
2026-03-30 05:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bc20db7-3ed0-5140-9211-4aa023214206 with identifier: CE80644
2026-03-30 05:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bc20db7-3ed0-5140-9211-4aa023214206 with identifier: CE80644 to the API
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:32:30Z',
 'fuel_type': 'diesel',
 'id': '8bc20db7-3ed0-5140-9211-4aa023214206',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE80644',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 115205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Saving data for CE80644: {'auction_closing_time': 1774884750.0, 'created_time': 1774639278.296625, 'last_price_update_time': 1774849201.921814}
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE80644') HTTP/1.1" 204 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for EJ52813: 0
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-30 05:40:01 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-30 05:40:01 [auto1.de] INFO: Scrape type for SX52884: 2
2026-03-30 05:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-30 05:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9293a7fc-975c-5476-8095-8bbef582dac7 with scrape type 2
2026-03-30 05:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9293a7fc-975c-5476-8095-8bbef582dac7 with scrape type 2
2026-03-30 05:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9293a7fc-975c-5476-8095-8bbef582dac7, identifier: SX52884
2026-03-30 05:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-30 05:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884
2026-03-30 05:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9293a7fc-975c-5476-8095-8bbef582dac7 with identifier: SX52884 to the API
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:40:01Z',
 'fuel_type': 'petrol',
 'id': '9293a7fc-975c-5476-8095-8bbef582dac7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX52884',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 38484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2020}
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-30 05:40:02 [auto1.de] INFO: Saving data for SX52884: {'auction_closing_time': 1774885201.0, 'created_time': 1773916961.561876, 'last_price_update_time': 1774849202.407427}
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX52884') HTTP/1.1" 204 0
2026-03-30 05:40:02 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-30 05:40:02 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-30 05:40:02 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-30 05:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:02 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:02 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-30 05:40:02 [auto1.de] INFO: Scrape type for HH54610: 2
2026-03-30 05:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with identifier: HH54610
2026-03-30 05:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with scrape type 2
2026-03-30 05:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with scrape type 2
2026-03-30 05:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d7dbbbf-f672-58ee-a048-1a1743bfee48, identifier: HH54610
2026-03-30 05:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with identifier: HH54610
2026-03-30 05:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with identifier: HH54610
2026-03-30 05:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d7dbbbf-f672-58ee-a048-1a1743bfee48 with identifier: HH54610 to the API
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:14:12Z',
 'fuel_type': 'petrol',
 'id': '6d7dbbbf-f672-58ee-a048-1a1743bfee48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH54610',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 40914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-20',
 'seller_name': None,
 'title': 'BMW 1er 128ti',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Saving data for HH54610: {'auction_closing_time': 1774883652.0, 'created_time': 1774637653.388112, 'last_price_update_time': 1774849203.305095}
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH54610') HTTP/1.1" 204 0
2026-03-30 05:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for BL02906: 2
2026-03-30 05:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-30 05:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32f433dc-2ce6-51d2-a2b3-b856df54f75f with scrape type 2
2026-03-30 05:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32f433dc-2ce6-51d2-a2b3-b856df54f75f with scrape type 2
2026-03-30 05:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32f433dc-2ce6-51d2-a2b3-b856df54f75f, identifier: BL02906
2026-03-30 05:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-30 05:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906
2026-03-30 05:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32f433dc-2ce6-51d2-a2b3-b856df54f75f with identifier: BL02906 to the API
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-30T15:06:26Z',
 'fuel_type': 'petrol',
 'id': '32f433dc-2ce6-51d2-a2b3-b856df54f75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL02906',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 81947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2020}
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Saving data for BL02906: {'auction_closing_time': 1774883186.0, 'created_time': 1774552351.930315, 'last_price_update_time': 1774849203.871145}
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL02906') HTTP/1.1" 204 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for MU06358: 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for ZY60733: 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-30 05:40:03 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-30 05:40:03 [auto1.de] INFO: Scrape type for GK32978: 2
2026-03-30 05:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1f2a4d-a7d5-5913-977e-f1673d7658d5 with identifier: GK32978
2026-03-30 05:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1f2a4d-a7d5-5913-977e-f1673d7658d5 with scrape type 2
2026-03-30 05:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1f2a4d-a7d5-5913-977e-f1673d7658d5 with scrape type 2
2026-03-30 05:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1f2a4d-a7d5-5913-977e-f1673d7658d5, identifier: GK32978
2026-03-30 05:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1f2a4d-a7d5-5913-977e-f1673d7658d5 with identifier: GK32978
2026-03-30 05:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1f2a4d-a7d5-5913-977e-f1673d7658d5 with identifier: GK32978
2026-03-30 05:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1f2a4d-a7d5-5913-977e-f1673d7658d5 with identifier: GK32978 to the API
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:33Z',
 'fuel_type': 'petrol',
 'id': 'da1f2a4d-a7d5-5913-977e-f1673d7658d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK32978',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 86009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-30 05:40:04 [auto1.de] INFO: Saving data for GK32978: {'auction_closing_time': 1774885833.0, 'created_time': 1774549980.829475, 'last_price_update_time': 1774849204.412227}
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK32978') HTTP/1.1" 204 0
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-30 05:40:04 [auto1.de] INFO: Scrape type for LC93569: 2
2026-03-30 05:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79415a9-40f9-5949-88c1-d7a1243b24b0 with identifier: LC93569
2026-03-30 05:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79415a9-40f9-5949-88c1-d7a1243b24b0 with scrape type 2
2026-03-30 05:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c79415a9-40f9-5949-88c1-d7a1243b24b0 with scrape type 2
2026-03-30 05:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c79415a9-40f9-5949-88c1-d7a1243b24b0, identifier: LC93569
2026-03-30 05:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c79415a9-40f9-5949-88c1-d7a1243b24b0 with identifier: LC93569
2026-03-30 05:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c79415a9-40f9-5949-88c1-d7a1243b24b0 with identifier: LC93569
2026-03-30 05:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c79415a9-40f9-5949-88c1-d7a1243b24b0 with identifier: LC93569 to the API
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'diesel',
 'id': 'c79415a9-40f9-5949-88c1-d7a1243b24b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC93569',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 147699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-30 05:40:04 [auto1.de] INFO: Saving data for LC93569: {'auction_closing_time': 1774885810.0, 'created_time': 1774637683.85135, 'last_price_update_time': 1774849204.819713}
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC93569') HTTP/1.1" 204 0
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-30 05:40:04 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-30 05:40:04 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-30 05:40:04 [auto1.de] INFO: Scrape type for DK10933: 2
2026-03-30 05:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-30 05:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2658b977-15be-5b07-8fe4-2e1d6f112459 with scrape type 2
2026-03-30 05:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2658b977-15be-5b07-8fe4-2e1d6f112459 with scrape type 2
2026-03-30 05:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2658b977-15be-5b07-8fe4-2e1d6f112459, identifier: DK10933
2026-03-30 05:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-30 05:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933
2026-03-30 05:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2658b977-15be-5b07-8fe4-2e1d6f112459 with identifier: DK10933 to the API
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 186,
 'expiration_date': '2026-03-30T15:02:59Z',
 'fuel_type': 'diesel',
 'id': '2658b977-15be-5b07-8fe4-2e1d6f112459',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK10933',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 25290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2024}
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Saving data for DK10933: {'auction_closing_time': 1774882979.0, 'created_time': 1774552339.585954, 'last_price_update_time': 1774849205.303797}
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK10933') HTTP/1.1" 204 0
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Scrape type for GC49390: 0
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Scrape type for XJ84301: 2
2026-03-30 05:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with identifier: XJ84301
2026-03-30 05:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with scrape type 2
2026-03-30 05:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with scrape type 2
2026-03-30 05:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56bc5286-bbf5-5c2f-8acf-e4dae7872a15, identifier: XJ84301
2026-03-30 05:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with identifier: XJ84301
2026-03-30 05:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with identifier: XJ84301
2026-03-30 05:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56bc5286-bbf5-5c2f-8acf-e4dae7872a15 with identifier: XJ84301 to the API
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:05Z',
 'fuel_type': 'diesel',
 'id': '56bc5286-bbf5-5c2f-8acf-e4dae7872a15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ84301',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 315867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Saving data for XJ84301: {'auction_closing_time': 1774886105.0, 'created_time': 1774637472.208416, 'last_price_update_time': 1774849205.709313}
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ84301') HTTP/1.1" 204 0
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Scrape type for VW88901: 0
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-30 05:40:05 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-30 05:40:05 [auto1.de] INFO: Scrape type for WF79557: 2
2026-03-30 05:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3725da-ca5d-547c-abb5-219657b62a41 with identifier: WF79557
2026-03-30 05:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3725da-ca5d-547c-abb5-219657b62a41 with scrape type 2
2026-03-30 05:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3725da-ca5d-547c-abb5-219657b62a41 with scrape type 2
2026-03-30 05:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a3725da-ca5d-547c-abb5-219657b62a41, identifier: WF79557
2026-03-30 05:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a3725da-ca5d-547c-abb5-219657b62a41 with identifier: WF79557
2026-03-30 05:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a3725da-ca5d-547c-abb5-219657b62a41 with identifier: WF79557
2026-03-30 05:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a3725da-ca5d-547c-abb5-219657b62a41 with identifier: WF79557 to the API
2026-03-30 05:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:18:38Z',
 'fuel_type': 'petrol',
 'id': '7a3725da-ca5d-547c-abb5-219657b62a41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF79557',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 104860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-05',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 Classic Blue',
 'transmission': 'manual',
 'trim': 'Classic Blue',
 'year': 2011}
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-30 05:40:06 [auto1.de] INFO: Saving data for WF79557: {'auction_closing_time': 1774883918.0, 'created_time': 1774639429.328077, 'last_price_update_time': 1774849206.147251}
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF79557') HTTP/1.1" 204 0
2026-03-30 05:40:06 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-30 05:40:06 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-30 05:40:06 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-30 05:40:06 [auto1.de] INFO: Scrape type for JS34798: 2
2026-03-30 05:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with identifier: JS34798
2026-03-30 05:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with scrape type 2
2026-03-30 05:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with scrape type 2
2026-03-30 05:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c69c9ea2-0f37-5e8e-8ea2-65c85d753d87, identifier: JS34798
2026-03-30 05:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with identifier: JS34798
2026-03-30 05:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with identifier: JS34798
2026-03-30 05:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c69c9ea2-0f37-5e8e-8ea2-65c85d753d87 with identifier: JS34798 to the API
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:49:01Z',
 'fuel_type': 'petrol',
 'id': 'c69c9ea2-0f37-5e8e-8ea2-65c85d753d87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS34798',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 62992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-30 05:40:06 [auto1.de] INFO: Saving data for JS34798: {'auction_closing_time': 1774885741.0, 'created_time': 1773225132.999039, 'last_price_update_time': 1774849206.622931}
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS34798') HTTP/1.1" 204 0
2026-03-30 05:40:06 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-30 05:40:06 [auto1.de] INFO: Scrape type for TT07076: 2
2026-03-30 05:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b00cd33-19fa-5e3d-bb32-4204835087f3 with identifier: TT07076
2026-03-30 05:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b00cd33-19fa-5e3d-bb32-4204835087f3 with scrape type 2
2026-03-30 05:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b00cd33-19fa-5e3d-bb32-4204835087f3 with scrape type 2
2026-03-30 05:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b00cd33-19fa-5e3d-bb32-4204835087f3, identifier: TT07076
2026-03-30 05:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:06 [scrapy.extensions.logstats] INFO: Crawled 124 pages (at 13 pages/min), scraped 837 items (at 121 items/min)
2026-03-30 05:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b00cd33-19fa-5e3d-bb32-4204835087f3 with identifier: TT07076
2026-03-30 05:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b00cd33-19fa-5e3d-bb32-4204835087f3 with identifier: TT07076
2026-03-30 05:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b00cd33-19fa-5e3d-bb32-4204835087f3 with identifier: TT07076 to the API
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:29Z',
 'fuel_type': 'petrol',
 'id': '2b00cd33-19fa-5e3d-bb32-4204835087f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT07076',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 28714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2021}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Saving data for TT07076: {'auction_closing_time': 1774884389.0, 'created_time': 1774033803.566359, 'last_price_update_time': 1774849207.034929}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT07076') HTTP/1.1" 204 0
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Scrape type for UW42720: 0
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-30 05:40:07 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: US56502
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Scrape type for US56502: 2
2026-03-30 05:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42041f80-9256-5fb2-8765-00d6aa260662 with identifier: US56502
2026-03-30 05:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42041f80-9256-5fb2-8765-00d6aa260662 with scrape type 2
2026-03-30 05:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42041f80-9256-5fb2-8765-00d6aa260662 with scrape type 2
2026-03-30 05:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42041f80-9256-5fb2-8765-00d6aa260662, identifier: US56502
2026-03-30 05:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42041f80-9256-5fb2-8765-00d6aa260662 with identifier: US56502
2026-03-30 05:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42041f80-9256-5fb2-8765-00d6aa260662 with identifier: US56502
2026-03-30 05:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42041f80-9256-5fb2-8765-00d6aa260662 with identifier: US56502 to the API
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:44:07Z',
 'fuel_type': 'petrol',
 'id': '42041f80-9256-5fb2-8765-00d6aa260662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US56502',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 135045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-05',
 'seller_name': None,
 'title': 'Ford Focus 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2005}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Saving data for US56502: {'auction_closing_time': 1774885447.0, 'created_time': 1774637275.826566, 'last_price_update_time': 1774849207.486587}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US56502') HTTP/1.1" 204 0
2026-03-30 05:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-30 05:40:07 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Scrape type for NV48270: 2
2026-03-30 05:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8123153c-4ab0-5a28-9920-9f4578c8adf9 with identifier: NV48270
2026-03-30 05:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8123153c-4ab0-5a28-9920-9f4578c8adf9 with scrape type 2
2026-03-30 05:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8123153c-4ab0-5a28-9920-9f4578c8adf9 with scrape type 2
2026-03-30 05:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8123153c-4ab0-5a28-9920-9f4578c8adf9, identifier: NV48270
2026-03-30 05:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8123153c-4ab0-5a28-9920-9f4578c8adf9 with identifier: NV48270
2026-03-30 05:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8123153c-4ab0-5a28-9920-9f4578c8adf9 with identifier: NV48270
2026-03-30 05:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8123153c-4ab0-5a28-9920-9f4578c8adf9 with identifier: NV48270 to the API
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'petrol',
 'id': '8123153c-4ab0-5a28-9920-9f4578c8adf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV48270',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 193572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-09',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-30 05:40:07 [auto1.de] INFO: Saving data for NV48270: {'auction_closing_time': 1774884618.0, 'created_time': 1774637130.929282, 'last_price_update_time': 1774849207.989675}
2026-03-30 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV48270') HTTP/1.1" 204 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for MX86281: 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for UJ83217: 2
2026-03-30 05:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d37856-1e25-5244-9b8c-0950998aac8f with identifier: UJ83217
2026-03-30 05:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d37856-1e25-5244-9b8c-0950998aac8f with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76d37856-1e25-5244-9b8c-0950998aac8f with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76d37856-1e25-5244-9b8c-0950998aac8f, identifier: UJ83217
2026-03-30 05:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76d37856-1e25-5244-9b8c-0950998aac8f with identifier: UJ83217
2026-03-30 05:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76d37856-1e25-5244-9b8c-0950998aac8f with identifier: UJ83217
2026-03-30 05:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76d37856-1e25-5244-9b8c-0950998aac8f with identifier: UJ83217 to the API
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:04:30Z',
 'fuel_type': 'petrol',
 'id': '76d37856-1e25-5244-9b8c-0950998aac8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ83217',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 63161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'BMW 5er 520i Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Saving data for UJ83217: {'auction_closing_time': 1774883070.0, 'created_time': 1774639153.633622, 'last_price_update_time': 1774849208.397007}
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ83217') HTTP/1.1" 204 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for HW30650: 2
2026-03-30 05:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-30 05:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13de3dc-47c1-59ba-b79e-6f0e9be52523 with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a13de3dc-47c1-59ba-b79e-6f0e9be52523 with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a13de3dc-47c1-59ba-b79e-6f0e9be52523, identifier: HW30650
2026-03-30 05:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-30 05:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650
2026-03-30 05:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a13de3dc-47c1-59ba-b79e-6f0e9be52523 with identifier: HW30650 to the API
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:13:43Z',
 'fuel_type': 'petrol',
 'id': 'a13de3dc-47c1-59ba-b79e-6f0e9be52523',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW30650',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 201711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2005}
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Saving data for HW30650: {'auction_closing_time': 1774883623.0, 'created_time': 1774552443.303493, 'last_price_update_time': 1774849208.781463}
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW30650') HTTP/1.1" 204 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-30 05:40:08 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-30 05:40:08 [auto1.de] INFO: Scrape type for YF72599: 2
2026-03-30 05:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with identifier: YF72599
2026-03-30 05:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with scrape type 2
2026-03-30 05:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee842bb-0232-5c6f-a594-f7b131fa52a3, identifier: YF72599
2026-03-30 05:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with identifier: YF72599
2026-03-30 05:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with identifier: YF72599
2026-03-30 05:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee842bb-0232-5c6f-a594-f7b131fa52a3 with identifier: YF72599 to the API
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:25Z',
 'fuel_type': 'petrol',
 'id': '3ee842bb-0232-5c6f-a594-f7b131fa52a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF72599',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 19606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake Mild-Hybrid AMG '
          'Line Edition',
 'transmission': 'automatic',
 'trim': 'AMG Line Edition',
 'year': 2023}
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-30 05:40:09 [auto1.de] INFO: Saving data for YF72599: {'auction_closing_time': 1774886005.0, 'created_time': 1773830269.697091, 'last_price_update_time': 1774849209.251939}
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF72599') HTTP/1.1" 204 0
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-30 05:40:09 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-30 05:40:09 [auto1.de] INFO: Scrape type for ZA79718: 2
2026-03-30 05:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b5f888-fc58-5425-a14f-553f330c6607 with identifier: ZA79718
2026-03-30 05:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b5f888-fc58-5425-a14f-553f330c6607 with scrape type 2
2026-03-30 05:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b5f888-fc58-5425-a14f-553f330c6607 with scrape type 2
2026-03-30 05:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b5f888-fc58-5425-a14f-553f330c6607, identifier: ZA79718
2026-03-30 05:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b5f888-fc58-5425-a14f-553f330c6607 with identifier: ZA79718
2026-03-30 05:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b5f888-fc58-5425-a14f-553f330c6607 with identifier: ZA79718
2026-03-30 05:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b5f888-fc58-5425-a14f-553f330c6607 with identifier: ZA79718 to the API
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'hybrid',
 'id': '22b5f888-fc58-5425-a14f-553f330c6607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA79718',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 173186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-08',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Plus 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Plus 4WD',
 'year': 2017}
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-30 05:40:09 [auto1.de] INFO: Saving data for ZA79718: {'auction_closing_time': 1774884157.0, 'created_time': 1774638754.901849, 'last_price_update_time': 1774849209.805871}
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA79718') HTTP/1.1" 204 0
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-30 05:40:09 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-30 05:40:09 [auto1.de] INFO: Scrape type for SY50059: 2
2026-03-30 05:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 378ada84-9b47-51c4-9de8-612e539fbcc2 with identifier: SY50059
2026-03-30 05:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 378ada84-9b47-51c4-9de8-612e539fbcc2 with scrape type 2
2026-03-30 05:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 378ada84-9b47-51c4-9de8-612e539fbcc2 with scrape type 2
2026-03-30 05:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 378ada84-9b47-51c4-9de8-612e539fbcc2, identifier: SY50059
2026-03-30 05:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 378ada84-9b47-51c4-9de8-612e539fbcc2 with identifier: SY50059
2026-03-30 05:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 378ada84-9b47-51c4-9de8-612e539fbcc2 with identifier: SY50059
2026-03-30 05:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 378ada84-9b47-51c4-9de8-612e539fbcc2 with identifier: SY50059 to the API
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:29Z',
 'fuel_type': 'petrol',
 'id': '378ada84-9b47-51c4-9de8-612e539fbcc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY50059',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 134717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Saving data for SY50059: {'auction_closing_time': 1774884029.0, 'created_time': 1773227388.295683, 'last_price_update_time': 1774849210.225238}
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY50059') HTTP/1.1" 204 0
2026-03-30 05:40:10 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Scrape type for MN48285: 0
2026-03-30 05:40:10 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-30 05:40:10 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-30 05:40:10 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Scrape type for PP24406: 2
2026-03-30 05:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-30 05:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45b6e915-4847-52ef-baf2-0f35e469953b with scrape type 2
2026-03-30 05:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45b6e915-4847-52ef-baf2-0f35e469953b with scrape type 2
2026-03-30 05:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45b6e915-4847-52ef-baf2-0f35e469953b, identifier: PP24406
2026-03-30 05:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-30 05:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406
2026-03-30 05:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45b6e915-4847-52ef-baf2-0f35e469953b with identifier: PP24406 to the API
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'petrol',
 'id': '45b6e915-4847-52ef-baf2-0f35e469953b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP24406',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 33839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2023}
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Saving data for PP24406: {'auction_closing_time': 1774883539.0, 'created_time': 1774550476.836465, 'last_price_update_time': 1774849210.649627}
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP24406') HTTP/1.1" 204 0
2026-03-30 05:40:10 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-30 05:40:10 [auto1.de] INFO: Scrape type for FM50450: 2
2026-03-30 05:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 590b3049-3f12-55d3-8b2e-d84f85904d14 with identifier: FM50450
2026-03-30 05:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 590b3049-3f12-55d3-8b2e-d84f85904d14 with scrape type 2
2026-03-30 05:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 590b3049-3f12-55d3-8b2e-d84f85904d14 with scrape type 2
2026-03-30 05:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 590b3049-3f12-55d3-8b2e-d84f85904d14, identifier: FM50450
2026-03-30 05:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 590b3049-3f12-55d3-8b2e-d84f85904d14 with identifier: FM50450
2026-03-30 05:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 590b3049-3f12-55d3-8b2e-d84f85904d14 with identifier: FM50450
2026-03-30 05:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 590b3049-3f12-55d3-8b2e-d84f85904d14 with identifier: FM50450 to the API
2026-03-30 05:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:09Z',
 'fuel_type': 'diesel',
 'id': '590b3049-3f12-55d3-8b2e-d84f85904d14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM50450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 191775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T Avantgarde',
 'transmission': 'manual',
 'trim': 'T Avantgarde',
 'year': 2008}
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Saving data for FM50450: {'auction_closing_time': 1774885329.0, 'created_time': 1773466685.371586, 'last_price_update_time': 1774849211.154407}
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM50450') HTTP/1.1" 204 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for MZ72093: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for TB77095: 2
2026-03-30 05:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-30 05:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7845e6bb-cfdf-531d-873b-09ec4cefd277 with scrape type 2
2026-03-30 05:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7845e6bb-cfdf-531d-873b-09ec4cefd277 with scrape type 2
2026-03-30 05:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7845e6bb-cfdf-531d-873b-09ec4cefd277, identifier: TB77095
2026-03-30 05:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-30 05:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095
2026-03-30 05:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7845e6bb-cfdf-531d-873b-09ec4cefd277 with identifier: TB77095 to the API
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:54:45Z',
 'fuel_type': 'diesel',
 'id': '7845e6bb-cfdf-531d-873b-09ec4cefd277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB77095',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 90262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Saving data for TB77095: {'auction_closing_time': 1774886085.0, 'created_time': 1773224125.364392, 'last_price_update_time': 1774849211.578542}
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB77095') HTTP/1.1" 204 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-30 05:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:11 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: US92808
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for WW27642: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for JC18235: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for SM51050: 0
2026-03-30 05:40:11 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-30 05:40:11 [auto1.de] INFO: Scrape type for EY51453: 2
2026-03-30 05:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf2d488a-2893-5fef-93ec-55ea18932e32 with identifier: EY51453
2026-03-30 05:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf2d488a-2893-5fef-93ec-55ea18932e32 with scrape type 2
2026-03-30 05:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf2d488a-2893-5fef-93ec-55ea18932e32 with scrape type 2
2026-03-30 05:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf2d488a-2893-5fef-93ec-55ea18932e32, identifier: EY51453
2026-03-30 05:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf2d488a-2893-5fef-93ec-55ea18932e32 with identifier: EY51453
2026-03-30 05:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf2d488a-2893-5fef-93ec-55ea18932e32 with identifier: EY51453
2026-03-30 05:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf2d488a-2893-5fef-93ec-55ea18932e32 with identifier: EY51453 to the API
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:16:14Z',
 'fuel_type': 'petrol',
 'id': 'bf2d488a-2893-5fef-93ec-55ea18932e32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY51453',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-19',
 'seller_name': None,
 'title': 'Opel Astra 1.8 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2001}
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Saving data for EY51453: {'auction_closing_time': 1774883774.0, 'created_time': 1774637135.866765, 'last_price_update_time': 1774849212.277174}
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY51453') HTTP/1.1" 204 0
2026-03-30 05:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for KJ60236: 2
2026-03-30 05:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1084786-72b7-5ac8-96b5-1e5699fb0874 with identifier: KJ60236
2026-03-30 05:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1084786-72b7-5ac8-96b5-1e5699fb0874 with scrape type 2
2026-03-30 05:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1084786-72b7-5ac8-96b5-1e5699fb0874 with scrape type 2
2026-03-30 05:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1084786-72b7-5ac8-96b5-1e5699fb0874, identifier: KJ60236
2026-03-30 05:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1084786-72b7-5ac8-96b5-1e5699fb0874 with identifier: KJ60236
2026-03-30 05:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1084786-72b7-5ac8-96b5-1e5699fb0874 with identifier: KJ60236
2026-03-30 05:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1084786-72b7-5ac8-96b5-1e5699fb0874 with identifier: KJ60236 to the API
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:00:06Z',
 'fuel_type': 'diesel',
 'id': 'a1084786-72b7-5ac8-96b5-1e5699fb0874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ60236',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 271940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-30',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Saving data for KJ60236: {'auction_closing_time': 1774882806.0, 'created_time': 1774637378.247622, 'last_price_update_time': 1774849212.834522}
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ60236') HTTP/1.1" 204 0
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 05:40:12 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-30 05:40:12 [auto1.de] INFO: Scrape type for UE90964: 2
2026-03-30 05:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a004a2-f022-59c7-9077-e4908f3d8655 with identifier: UE90964
2026-03-30 05:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a004a2-f022-59c7-9077-e4908f3d8655 with scrape type 2
2026-03-30 05:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18a004a2-f022-59c7-9077-e4908f3d8655 with scrape type 2
2026-03-30 05:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a004a2-f022-59c7-9077-e4908f3d8655, identifier: UE90964
2026-03-30 05:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a004a2-f022-59c7-9077-e4908f3d8655 with identifier: UE90964
2026-03-30 05:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a004a2-f022-59c7-9077-e4908f3d8655 with identifier: UE90964
2026-03-30 05:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a004a2-f022-59c7-9077-e4908f3d8655 with identifier: UE90964 to the API
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-30T15:53:22Z',
 'fuel_type': 'hybrid',
 'id': '18a004a2-f022-59c7-9077-e4908f3d8655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE90964',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 170767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Hyundai IONIQ 1.6 Hybrid Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2016}
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-30 05:40:13 [auto1.de] INFO: Saving data for UE90964: {'auction_closing_time': 1774886002.0, 'created_time': 1774002856.554225, 'last_price_update_time': 1774849213.341797}
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE90964') HTTP/1.1" 204 0
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-30 05:40:13 [auto1.de] INFO: Scrape type for NT88605: 2
2026-03-30 05:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-30 05:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 2
2026-03-30 05:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with scrape type 2
2026-03-30 05:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d58cd1d-270c-556e-ad38-8cc097ae2a30, identifier: NT88605
2026-03-30 05:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-30 05:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605
2026-03-30 05:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d58cd1d-270c-556e-ad38-8cc097ae2a30 with identifier: NT88605 to the API
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:55Z',
 'fuel_type': 'petrol',
 'id': '2d58cd1d-270c-556e-ad38-8cc097ae2a30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT88605',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Sound',
 'transmission': 'automatic',
 'trim': 'Sound',
 'year': 2017}
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-30 05:40:13 [auto1.de] INFO: Saving data for NT88605: {'auction_closing_time': 1774884835.0, 'created_time': 1774552933.834744, 'last_price_update_time': 1774849213.742253}
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT88605') HTTP/1.1" 204 0
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-30 05:40:13 [auto1.de] INFO: Scrape type for JG45711: 0
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 05:40:13 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-30 05:40:13 [auto1.de] INFO: Scrape type for LH30739: 0
2026-03-30 05:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:14 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:14 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-30 05:40:14 [auto1.de] INFO: Scrape type for WS48459: 2
2026-03-30 05:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38037812-ee3b-50d6-a005-ab9f71941f54 with identifier: WS48459
2026-03-30 05:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38037812-ee3b-50d6-a005-ab9f71941f54 with scrape type 2
2026-03-30 05:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38037812-ee3b-50d6-a005-ab9f71941f54 with scrape type 2
2026-03-30 05:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38037812-ee3b-50d6-a005-ab9f71941f54, identifier: WS48459
2026-03-30 05:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38037812-ee3b-50d6-a005-ab9f71941f54 with identifier: WS48459
2026-03-30 05:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38037812-ee3b-50d6-a005-ab9f71941f54 with identifier: WS48459
2026-03-30 05:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38037812-ee3b-50d6-a005-ab9f71941f54 with identifier: WS48459 to the API
2026-03-30 05:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:58:44Z',
 'fuel_type': 'diesel',
 'id': '38037812-ee3b-50d6-a005-ab9f71941f54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS48459',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 137881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Combi L1H1 2,7t',
 'year': 2015}
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Saving data for WS48459: {'auction_closing_time': 1774886324.0, 'created_time': 1774034583.736438, 'last_price_update_time': 1774849215.102456}
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WS48459') HTTP/1.1" 204 0
2026-03-30 05:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for DP54088: 2
2026-03-30 05:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c491968-d737-5e7e-919f-bed51d4e0ce9 with identifier: DP54088
2026-03-30 05:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c491968-d737-5e7e-919f-bed51d4e0ce9 with scrape type 2
2026-03-30 05:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c491968-d737-5e7e-919f-bed51d4e0ce9 with scrape type 2
2026-03-30 05:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c491968-d737-5e7e-919f-bed51d4e0ce9, identifier: DP54088
2026-03-30 05:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c491968-d737-5e7e-919f-bed51d4e0ce9 with identifier: DP54088
2026-03-30 05:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c491968-d737-5e7e-919f-bed51d4e0ce9 with identifier: DP54088
2026-03-30 05:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c491968-d737-5e7e-919f-bed51d4e0ce9 with identifier: DP54088 to the API
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'petrol',
 'id': '4c491968-d737-5e7e-919f-bed51d4e0ce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP54088',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 118753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-04',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Saving data for DP54088: {'auction_closing_time': 1774885382.0, 'created_time': 1774637379.082999, 'last_price_update_time': 1774849215.633069}
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP54088') HTTP/1.1" 204 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for PC42452: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for YH26863: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 05:40:15 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-30 05:40:15 [auto1.de] INFO: Scrape type for NV84583: 2
2026-03-30 05:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f580abdf-4bbb-5bc1-8500-ec7a2391852a with identifier: NV84583
2026-03-30 05:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f580abdf-4bbb-5bc1-8500-ec7a2391852a with scrape type 2
2026-03-30 05:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f580abdf-4bbb-5bc1-8500-ec7a2391852a with scrape type 2
2026-03-30 05:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f580abdf-4bbb-5bc1-8500-ec7a2391852a, identifier: NV84583
2026-03-30 05:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f580abdf-4bbb-5bc1-8500-ec7a2391852a with identifier: NV84583
2026-03-30 05:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f580abdf-4bbb-5bc1-8500-ec7a2391852a with identifier: NV84583
2026-03-30 05:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f580abdf-4bbb-5bc1-8500-ec7a2391852a with identifier: NV84583 to the API
2026-03-30 05:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:38:20Z',
 'fuel_type': 'petrol',
 'id': 'f580abdf-4bbb-5bc1-8500-ec7a2391852a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV84583',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 33395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'BMW 4er M4 xDrive Competition',
 'transmission': 'automatic',
 'trim': 'xDrive Competition',
 'year': 2022}
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-30 05:40:16 [auto1.de] INFO: Saving data for NV84583: {'auction_closing_time': 1774885100.0, 'created_time': 1774636962.351056, 'last_price_update_time': 1774849216.179087}
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV84583') HTTP/1.1" 204 0
2026-03-30 05:40:16 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-30 05:40:16 [auto1.de] INFO: Scrape type for ER69054: 2
2026-03-30 05:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-30 05:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39f08ffb-6c44-597f-b3d0-8a7d031c71db with scrape type 2
2026-03-30 05:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39f08ffb-6c44-597f-b3d0-8a7d031c71db with scrape type 2
2026-03-30 05:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39f08ffb-6c44-597f-b3d0-8a7d031c71db, identifier: ER69054
2026-03-30 05:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-30 05:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054
2026-03-30 05:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39f08ffb-6c44-597f-b3d0-8a7d031c71db with identifier: ER69054 to the API
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:40:04Z',
 'fuel_type': 'diesel',
 'id': '39f08ffb-6c44-597f-b3d0-8a7d031c71db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER69054',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 97481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L4H1 3,5t',
 'transmission': 'manual',
 'trim': 'L4H1 3,5t',
 'year': 2023}
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-30 05:40:16 [auto1.de] INFO: Saving data for ER69054: {'auction_closing_time': 1774885204.0, 'created_time': 1774552492.631887, 'last_price_update_time': 1774849216.679756}
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER69054') HTTP/1.1" 204 0
2026-03-30 05:40:16 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-30 05:40:16 [auto1.de] INFO: Scrape type for TA30893: 2
2026-03-30 05:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da23f29d-85d9-50fe-bf60-0503135d6a73 with identifier: TA30893
2026-03-30 05:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da23f29d-85d9-50fe-bf60-0503135d6a73 with scrape type 2
2026-03-30 05:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da23f29d-85d9-50fe-bf60-0503135d6a73 with scrape type 2
2026-03-30 05:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da23f29d-85d9-50fe-bf60-0503135d6a73, identifier: TA30893
2026-03-30 05:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da23f29d-85d9-50fe-bf60-0503135d6a73 with identifier: TA30893
2026-03-30 05:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da23f29d-85d9-50fe-bf60-0503135d6a73 with identifier: TA30893
2026-03-30 05:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da23f29d-85d9-50fe-bf60-0503135d6a73 with identifier: TA30893 to the API
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:57:58Z',
 'fuel_type': 'petrol',
 'id': 'da23f29d-85d9-50fe-bf60-0503135d6a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA30893',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 77629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2023}
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-30 05:40:17 [auto1.de] INFO: Saving data for TA30893: {'auction_closing_time': 1774886278.0, 'created_time': 1774639422.091901, 'last_price_update_time': 1774849217.093917}
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA30893') HTTP/1.1" 204 0
2026-03-30 05:40:17 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-30 05:40:17 [auto1.de] INFO: Scrape type for DH72575: 2
2026-03-30 05:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7bfad18-70a5-5b69-b93f-d30c6c18e244 with identifier: DH72575
2026-03-30 05:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7bfad18-70a5-5b69-b93f-d30c6c18e244 with scrape type 2
2026-03-30 05:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7bfad18-70a5-5b69-b93f-d30c6c18e244 with scrape type 2
2026-03-30 05:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7bfad18-70a5-5b69-b93f-d30c6c18e244, identifier: DH72575
2026-03-30 05:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7bfad18-70a5-5b69-b93f-d30c6c18e244 with identifier: DH72575
2026-03-30 05:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7bfad18-70a5-5b69-b93f-d30c6c18e244 with identifier: DH72575
2026-03-30 05:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7bfad18-70a5-5b69-b93f-d30c6c18e244 with identifier: DH72575 to the API
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:56:09Z',
 'fuel_type': 'diesel',
 'id': 'b7bfad18-70a5-5b69-b93f-d30c6c18e244',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH72575',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 262401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-22',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Edition 30 4Motion',
 'transmission': 'automatic',
 'trim': 'Edition 30 4Motion',
 'year': 2016}
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-30 05:40:17 [auto1.de] INFO: Saving data for DH72575: {'auction_closing_time': 1774886169.0, 'created_time': 1774002446.460199, 'last_price_update_time': 1774849217.495294}
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH72575') HTTP/1.1" 204 0
2026-03-30 05:40:17 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-30 05:40:17 [auto1.de] INFO: Scrape type for UP40831: 2
2026-03-30 05:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with identifier: UP40831
2026-03-30 05:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with scrape type 2
2026-03-30 05:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with scrape type 2
2026-03-30 05:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f5e70d2-fa70-5d31-92a3-80cf326ffc87, identifier: UP40831
2026-03-30 05:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with identifier: UP40831
2026-03-30 05:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with identifier: UP40831
2026-03-30 05:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f5e70d2-fa70-5d31-92a3-80cf326ffc87 with identifier: UP40831 to the API
2026-03-30 05:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'petrol',
 'id': '4f5e70d2-fa70-5d31-92a3-80cf326ffc87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP40831',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 239106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI R-Line Edition Plus',
 'transmission': 'manual',
 'trim': 'R-Line Edition Plus',
 'year': 2010}
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-30 05:40:18 [auto1.de] INFO: Saving data for UP40831: {'auction_closing_time': 1774885395.0, 'created_time': 1774521894.103829, 'last_price_update_time': 1774849218.806765}
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP40831') HTTP/1.1" 204 0
2026-03-30 05:40:18 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-30 05:40:18 [auto1.de] INFO: Scrape type for UY98084: 2
2026-03-30 05:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with identifier: UY98084
2026-03-30 05:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with scrape type 2
2026-03-30 05:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with scrape type 2
2026-03-30 05:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8, identifier: UY98084
2026-03-30 05:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with identifier: UY98084
2026-03-30 05:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with identifier: UY98084
2026-03-30 05:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48fd6ff6-5174-5d92-9fc9-8a7303eb59f8 with identifier: UY98084 to the API
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:53:04Z',
 'fuel_type': 'petrol',
 'id': '48fd6ff6-5174-5d92-9fc9-8a7303eb59f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY98084',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 60638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-16',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2017}
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-30 05:40:19 [auto1.de] INFO: Saving data for UY98084: {'auction_closing_time': 1774885984.0, 'created_time': 1774639118.457889, 'last_price_update_time': 1774849219.834019}
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY98084') HTTP/1.1" 204 0
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-30 05:40:19 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-30 05:40:19 [auto1.de] INFO: Scrape type for FY46967: 2
2026-03-30 05:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 542bb857-8ded-5723-ac12-86f582d9b81a with identifier: FY46967
2026-03-30 05:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 542bb857-8ded-5723-ac12-86f582d9b81a with scrape type 2
2026-03-30 05:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 542bb857-8ded-5723-ac12-86f582d9b81a with scrape type 2
2026-03-30 05:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 542bb857-8ded-5723-ac12-86f582d9b81a, identifier: FY46967
2026-03-30 05:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 542bb857-8ded-5723-ac12-86f582d9b81a with identifier: FY46967
2026-03-30 05:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 542bb857-8ded-5723-ac12-86f582d9b81a with identifier: FY46967
2026-03-30 05:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 542bb857-8ded-5723-ac12-86f582d9b81a with identifier: FY46967 to the API
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:12Z',
 'fuel_type': 'petrol',
 'id': '542bb857-8ded-5723-ac12-86f582d9b81a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY46967',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 113486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2010}
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-30 05:40:20 [auto1.de] INFO: Saving data for FY46967: {'auction_closing_time': 1774882812.0, 'created_time': 1774636648.33885, 'last_price_update_time': 1774849220.257729}
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY46967') HTTP/1.1" 204 0
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-30 05:40:20 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-30 05:40:20 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-30 05:40:20 [auto1.de] INFO: Scrape type for XS50752: 2
2026-03-30 05:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-30 05:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with scrape type 2
2026-03-30 05:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with scrape type 2
2026-03-30 05:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 907f5881-bdc7-56ab-a9e8-3755bdf0c496, identifier: XS50752
2026-03-30 05:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-30 05:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752
2026-03-30 05:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 907f5881-bdc7-56ab-a9e8-3755bdf0c496 with identifier: XS50752 to the API
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'diesel',
 'id': '907f5881-bdc7-56ab-a9e8-3755bdf0c496',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS50752',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 69276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-30 05:40:20 [auto1.de] INFO: Saving data for XS50752: {'auction_closing_time': 1774885688.0, 'created_time': 1774552665.939813, 'last_price_update_time': 1774849220.808616}
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS50752') HTTP/1.1" 204 0
2026-03-30 05:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:20 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-30 05:40:20 [auto1.de] INFO: Scrape type for LR98326: 2
2026-03-30 05:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-30 05:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with scrape type 2
2026-03-30 05:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with scrape type 2
2026-03-30 05:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7, identifier: LR98326
2026-03-30 05:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-30 05:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326
2026-03-30 05:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7 with identifier: LR98326 to the API
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:56:11Z',
 'fuel_type': 'petrol',
 'id': '23c7f25c-7aff-5d4b-be6f-1d3d1f4daca7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR98326',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XJ',
 'odometer': 292611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-16',
 'seller_name': None,
 'title': 'Jaguar XJ 3.0 V6 XJ6',
 'transmission': 'automatic',
 'trim': '6',
 'year': 2005}
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Saving data for LR98326: {'auction_closing_time': 1774886171.0, 'created_time': 1774550651.01163, 'last_price_update_time': 1774849221.322413}
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR98326') HTTP/1.1" 204 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for RA28686: 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for WD34588: 2
2026-03-30 05:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with identifier: WD34588
2026-03-30 05:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with scrape type 2
2026-03-30 05:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with scrape type 2
2026-03-30 05:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c, identifier: WD34588
2026-03-30 05:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with identifier: WD34588
2026-03-30 05:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with identifier: WD34588
2026-03-30 05:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e9b4ea5-64ef-5ed6-9aab-44a2624f521c with identifier: WD34588 to the API
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:05:29Z',
 'fuel_type': 'diesel',
 'id': '9e9b4ea5-64ef-5ed6-9aab-44a2624f521c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD34588',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 113195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2015}
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Saving data for WD34588: {'auction_closing_time': 1774883129.0, 'created_time': 1773304558.279808, 'last_price_update_time': 1774849221.759602}
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD34588') HTTP/1.1" 204 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-30 05:40:21 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-30 05:40:21 [auto1.de] INFO: Scrape type for UA17642: 2
2026-03-30 05:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-30 05:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281c48a2-9001-5867-bc78-232153fdb6a3 with scrape type 2
2026-03-30 05:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281c48a2-9001-5867-bc78-232153fdb6a3 with scrape type 2
2026-03-30 05:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 281c48a2-9001-5867-bc78-232153fdb6a3, identifier: UA17642
2026-03-30 05:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-30 05:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642
2026-03-30 05:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 281c48a2-9001-5867-bc78-232153fdb6a3 with identifier: UA17642 to the API
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'petrol',
 'id': '281c48a2-9001-5867-bc78-232153fdb6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA17642',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 45161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-17',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-30 05:40:22 [auto1.de] INFO: Saving data for UA17642: {'auction_closing_time': 1774885395.0, 'created_time': 1774552947.821317, 'last_price_update_time': 1774849222.219065}
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA17642') HTTP/1.1" 204 0
2026-03-30 05:40:22 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-30 05:40:22 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-30 05:40:22 [auto1.de] INFO: Scrape type for TH04951: 2
2026-03-30 05:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dea3bf22-a639-574f-9610-8a653de81c6b with identifier: TH04951
2026-03-30 05:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dea3bf22-a639-574f-9610-8a653de81c6b with scrape type 2
2026-03-30 05:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dea3bf22-a639-574f-9610-8a653de81c6b with scrape type 2
2026-03-30 05:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dea3bf22-a639-574f-9610-8a653de81c6b, identifier: TH04951
2026-03-30 05:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dea3bf22-a639-574f-9610-8a653de81c6b with identifier: TH04951
2026-03-30 05:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dea3bf22-a639-574f-9610-8a653de81c6b with identifier: TH04951
2026-03-30 05:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dea3bf22-a639-574f-9610-8a653de81c6b with identifier: TH04951 to the API
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:52:14Z',
 'fuel_type': 'diesel',
 'id': 'dea3bf22-a639-574f-9610-8a653de81c6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH04951',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 79478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-30 05:40:22 [auto1.de] INFO: Saving data for TH04951: {'auction_closing_time': 1774885934.0, 'created_time': 1774638532.043692, 'last_price_update_time': 1774849222.616509}
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH04951') HTTP/1.1" 204 0
2026-03-30 05:40:22 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-30 05:40:22 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-30 05:40:22 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-30 05:40:22 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-30 05:40:22 [auto1.de] INFO: Scrape type for TF57163: 2
2026-03-30 05:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5057fce4-61da-59ab-b161-47334d4fff5a with identifier: TF57163
2026-03-30 05:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5057fce4-61da-59ab-b161-47334d4fff5a with scrape type 2
2026-03-30 05:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5057fce4-61da-59ab-b161-47334d4fff5a with scrape type 2
2026-03-30 05:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5057fce4-61da-59ab-b161-47334d4fff5a, identifier: TF57163
2026-03-30 05:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5057fce4-61da-59ab-b161-47334d4fff5a with identifier: TF57163
2026-03-30 05:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5057fce4-61da-59ab-b161-47334d4fff5a with identifier: TF57163
2026-03-30 05:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5057fce4-61da-59ab-b161-47334d4fff5a with identifier: TF57163 to the API
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:27:26Z',
 'fuel_type': 'petrol',
 'id': '5057fce4-61da-59ab-b161-47334d4fff5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF57163',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 59857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-30 05:40:23 [auto1.de] INFO: Saving data for TF57163: {'auction_closing_time': 1774884446.0, 'created_time': 1774349447.677633, 'last_price_update_time': 1774849223.046655}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF57163') HTTP/1.1" 204 0
2026-03-30 05:40:23 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-30 05:40:23 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-30 05:40:23 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-30 05:40:23 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-30 05:40:23 [auto1.de] INFO: Scrape type for GA13082: 2
2026-03-30 05:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e27d1f1e-fef6-5202-adb5-40e7673f7a84 with identifier: GA13082
2026-03-30 05:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e27d1f1e-fef6-5202-adb5-40e7673f7a84 with scrape type 2
2026-03-30 05:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e27d1f1e-fef6-5202-adb5-40e7673f7a84 with scrape type 2
2026-03-30 05:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e27d1f1e-fef6-5202-adb5-40e7673f7a84, identifier: GA13082
2026-03-30 05:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e27d1f1e-fef6-5202-adb5-40e7673f7a84 with identifier: GA13082
2026-03-30 05:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e27d1f1e-fef6-5202-adb5-40e7673f7a84 with identifier: GA13082
2026-03-30 05:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e27d1f1e-fef6-5202-adb5-40e7673f7a84 with identifier: GA13082 to the API
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:40:11Z',
 'fuel_type': 'hybrid',
 'id': 'e27d1f1e-fef6-5202-adb5-40e7673f7a84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA13082',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 83123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Hybrid T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2017}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-30 05:40:23 [auto1.de] INFO: Saving data for GA13082: {'auction_closing_time': 1774885211.0, 'created_time': 1774636762.861552, 'last_price_update_time': 1774849223.571623}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA13082') HTTP/1.1" 204 0
2026-03-30 05:40:23 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-30 05:40:23 [auto1.de] INFO: Scrape type for DR68072: 2
2026-03-30 05:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e892c8b6-6224-5e45-b082-d9ee3ee47088 with identifier: DR68072
2026-03-30 05:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e892c8b6-6224-5e45-b082-d9ee3ee47088 with scrape type 2
2026-03-30 05:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e892c8b6-6224-5e45-b082-d9ee3ee47088 with scrape type 2
2026-03-30 05:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e892c8b6-6224-5e45-b082-d9ee3ee47088, identifier: DR68072
2026-03-30 05:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e892c8b6-6224-5e45-b082-d9ee3ee47088 with identifier: DR68072
2026-03-30 05:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e892c8b6-6224-5e45-b082-d9ee3ee47088 with identifier: DR68072
2026-03-30 05:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e892c8b6-6224-5e45-b082-d9ee3ee47088 with identifier: DR68072 to the API
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:43:57Z',
 'fuel_type': 'diesel',
 'id': 'e892c8b6-6224-5e45-b082-d9ee3ee47088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR68072',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 282584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-30 05:40:23 [auto1.de] INFO: Saving data for DR68072: {'auction_closing_time': 1774885437.0, 'created_time': 1774637235.60528, 'last_price_update_time': 1774849223.989795}
2026-03-30 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR68072') HTTP/1.1" 204 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for MH34813: 2
2026-03-30 05:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9efcb9c9-3212-5c19-9a29-88b445fad04c with identifier: MH34813
2026-03-30 05:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9efcb9c9-3212-5c19-9a29-88b445fad04c with scrape type 2
2026-03-30 05:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9efcb9c9-3212-5c19-9a29-88b445fad04c with scrape type 2
2026-03-30 05:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9efcb9c9-3212-5c19-9a29-88b445fad04c, identifier: MH34813
2026-03-30 05:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9efcb9c9-3212-5c19-9a29-88b445fad04c with identifier: MH34813
2026-03-30 05:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9efcb9c9-3212-5c19-9a29-88b445fad04c with identifier: MH34813
2026-03-30 05:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9efcb9c9-3212-5c19-9a29-88b445fad04c with identifier: MH34813 to the API
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:00:33Z',
 'fuel_type': 'diesel',
 'id': '9efcb9c9-3212-5c19-9a29-88b445fad04c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH34813',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 195356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi N-Vision 4x4',
 'transmission': 'automatic',
 'trim': 'N-Vision 4x4',
 'year': 2017}
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Saving data for MH34813: {'auction_closing_time': 1774882833.0, 'created_time': 1774639407.861225, 'last_price_update_time': 1774849224.447984}
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH34813') HTTP/1.1" 204 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for BF61357: 2
2026-03-30 05:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d5cad82-5586-5159-9293-5423e74552a1 with identifier: BF61357
2026-03-30 05:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d5cad82-5586-5159-9293-5423e74552a1 with scrape type 2
2026-03-30 05:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d5cad82-5586-5159-9293-5423e74552a1 with scrape type 2
2026-03-30 05:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d5cad82-5586-5159-9293-5423e74552a1, identifier: BF61357
2026-03-30 05:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d5cad82-5586-5159-9293-5423e74552a1 with identifier: BF61357
2026-03-30 05:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d5cad82-5586-5159-9293-5423e74552a1 with identifier: BF61357
2026-03-30 05:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d5cad82-5586-5159-9293-5423e74552a1 with identifier: BF61357 to the API
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:21:07Z',
 'fuel_type': 'petrol',
 'id': '2d5cad82-5586-5159-9293-5423e74552a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF61357',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 162476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference Salsa',
 'transmission': 'manual',
 'trim': 'Reference Salsa',
 'year': 2013}
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Saving data for BF61357: {'auction_closing_time': 1774884067.0, 'created_time': 1774638394.166606, 'last_price_update_time': 1774849224.856786}
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF61357') HTTP/1.1" 204 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-30 05:40:24 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-30 05:40:24 [auto1.de] INFO: Scrape type for MY99054: 2
2026-03-30 05:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with identifier: MY99054
2026-03-30 05:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with scrape type 2
2026-03-30 05:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with scrape type 2
2026-03-30 05:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cb57c2b-a548-5928-8a83-ca0edf8aef6a, identifier: MY99054
2026-03-30 05:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with identifier: MY99054
2026-03-30 05:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with identifier: MY99054
2026-03-30 05:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cb57c2b-a548-5928-8a83-ca0edf8aef6a with identifier: MY99054 to the API
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:02Z',
 'fuel_type': 'diesel',
 'id': '6cb57c2b-a548-5928-8a83-ca0edf8aef6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY99054',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 214126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-05',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2012}
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Saving data for MY99054: {'auction_closing_time': 1774884122.0, 'created_time': 1774032323.788809, 'last_price_update_time': 1774849225.2871}
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY99054') HTTP/1.1" 204 0
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Scrape type for ZF64276: 0
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Scrape type for VH67229: 2
2026-03-30 05:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-30 05:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with scrape type 2
2026-03-30 05:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with scrape type 2
2026-03-30 05:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f, identifier: VH67229
2026-03-30 05:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-30 05:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229
2026-03-30 05:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d25aeb51-4fde-5bfa-9c9d-88b68a6ba61f with identifier: VH67229 to the API
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:20:12Z',
 'fuel_type': 'diesel',
 'id': 'd25aeb51-4fde-5bfa-9c9d-88b68a6ba61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH67229',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 222043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Saving data for VH67229: {'auction_closing_time': 1774884012.0, 'created_time': 1774552436.979431, 'last_price_update_time': 1774849225.800229}
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH67229') HTTP/1.1" 204 0
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-30 05:40:25 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-30 05:40:25 [auto1.de] INFO: Scrape type for BU39152: 2
2026-03-30 05:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1944127b-516a-54c0-9bbf-f83c759ff8d3 with identifier: BU39152
2026-03-30 05:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1944127b-516a-54c0-9bbf-f83c759ff8d3 with scrape type 2
2026-03-30 05:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1944127b-516a-54c0-9bbf-f83c759ff8d3 with scrape type 2
2026-03-30 05:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1944127b-516a-54c0-9bbf-f83c759ff8d3, identifier: BU39152
2026-03-30 05:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1944127b-516a-54c0-9bbf-f83c759ff8d3 with identifier: BU39152
2026-03-30 05:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1944127b-516a-54c0-9bbf-f83c759ff8d3 with identifier: BU39152
2026-03-30 05:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1944127b-516a-54c0-9bbf-f83c759ff8d3 with identifier: BU39152 to the API
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:00:00Z',
 'fuel_type': 'petrol',
 'id': '1944127b-516a-54c0-9bbf-f83c759ff8d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU39152',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 36945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-28',
 'seller_name': None,
 'title': 'Mazda 6 2.5 SKYACTIV-G Homura',
 'transmission': 'automatic',
 'trim': 'Homura',
 'year': 2022}
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Saving data for BU39152: {'auction_closing_time': 1774882800.0, 'created_time': 1774639440.492898, 'last_price_update_time': 1774849226.288214}
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU39152') HTTP/1.1" 204 0
2026-03-30 05:40:26 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for NF91917: 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for BU76386: 2
2026-03-30 05:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96d87058-eb73-5fa9-8404-dc4adebec4bb with identifier: BU76386
2026-03-30 05:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96d87058-eb73-5fa9-8404-dc4adebec4bb with scrape type 2
2026-03-30 05:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96d87058-eb73-5fa9-8404-dc4adebec4bb with scrape type 2
2026-03-30 05:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96d87058-eb73-5fa9-8404-dc4adebec4bb, identifier: BU76386
2026-03-30 05:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96d87058-eb73-5fa9-8404-dc4adebec4bb with identifier: BU76386
2026-03-30 05:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96d87058-eb73-5fa9-8404-dc4adebec4bb with identifier: BU76386
2026-03-30 05:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96d87058-eb73-5fa9-8404-dc4adebec4bb with identifier: BU76386 to the API
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:24:33Z',
 'fuel_type': 'diesel',
 'id': '96d87058-eb73-5fa9-8404-dc4adebec4bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU76386',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 99932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2015}
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Saving data for BU76386: {'auction_closing_time': 1774884273.0, 'created_time': 1774636633.771389, 'last_price_update_time': 1774849226.727125}
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU76386') HTTP/1.1" 204 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for TW80485: 0
2026-03-30 05:40:26 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-30 05:40:26 [auto1.de] INFO: Scrape type for JD76793: 2
2026-03-30 05:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-30 05:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c486f9-b256-55b6-a737-688a2d950b31 with scrape type 2
2026-03-30 05:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c486f9-b256-55b6-a737-688a2d950b31 with scrape type 2
2026-03-30 05:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c486f9-b256-55b6-a737-688a2d950b31, identifier: JD76793
2026-03-30 05:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-30 05:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793
2026-03-30 05:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c486f9-b256-55b6-a737-688a2d950b31 with identifier: JD76793 to the API
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:07:48Z',
 'fuel_type': 'petrol',
 'id': '54c486f9-b256-55b6-a737-688a2d950b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD76793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 159786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-19',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-30 05:40:27 [auto1.de] INFO: Saving data for JD76793: {'auction_closing_time': 1774883268.0, 'created_time': 1774552909.202751, 'last_price_update_time': 1774849227.322356}
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD76793') HTTP/1.1" 204 0
2026-03-30 05:40:27 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-30 05:40:27 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-30 05:40:27 [auto1.de] INFO: Scrape type for TZ00942: 2
2026-03-30 05:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d22434d-561f-5a23-880e-0f7c12b37d45 with identifier: TZ00942
2026-03-30 05:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d22434d-561f-5a23-880e-0f7c12b37d45 with scrape type 2
2026-03-30 05:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d22434d-561f-5a23-880e-0f7c12b37d45 with scrape type 2
2026-03-30 05:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d22434d-561f-5a23-880e-0f7c12b37d45, identifier: TZ00942
2026-03-30 05:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d22434d-561f-5a23-880e-0f7c12b37d45 with identifier: TZ00942
2026-03-30 05:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d22434d-561f-5a23-880e-0f7c12b37d45 with identifier: TZ00942
2026-03-30 05:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d22434d-561f-5a23-880e-0f7c12b37d45 with identifier: TZ00942 to the API
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 411,
 'expiration_date': '2026-03-30T15:02:05Z',
 'fuel_type': 'petrol',
 'id': '9d22434d-561f-5a23-880e-0f7c12b37d45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ00942',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 52466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'BMW 2er M2 Competition',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2019}
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-30 05:40:27 [auto1.de] INFO: Saving data for TZ00942: {'auction_closing_time': 1774882925.0, 'created_time': 1773344813.731609, 'last_price_update_time': 1774849227.748199}
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ00942') HTTP/1.1" 204 0
2026-03-30 05:40:27 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-30 05:40:27 [auto1.de] INFO: Scrape type for TY10898: 2
2026-03-30 05:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76068fb2-9689-5232-86d8-994b1434a138 with identifier: TY10898
2026-03-30 05:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76068fb2-9689-5232-86d8-994b1434a138 with scrape type 2
2026-03-30 05:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76068fb2-9689-5232-86d8-994b1434a138 with scrape type 2
2026-03-30 05:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76068fb2-9689-5232-86d8-994b1434a138, identifier: TY10898
2026-03-30 05:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76068fb2-9689-5232-86d8-994b1434a138 with identifier: TY10898
2026-03-30 05:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76068fb2-9689-5232-86d8-994b1434a138 with identifier: TY10898
2026-03-30 05:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76068fb2-9689-5232-86d8-994b1434a138 with identifier: TY10898 to the API
2026-03-30 05:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:32Z',
 'fuel_type': 'diesel',
 'id': '76068fb2-9689-5232-86d8-994b1434a138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY10898',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 76992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 BLUE dCi Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2020}
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Saving data for TY10898: {'auction_closing_time': 1774883012.0, 'created_time': 1773427142.102133, 'last_price_update_time': 1774849228.166752}
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY10898') HTTP/1.1" 204 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for KT36384: 2
2026-03-30 05:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8496fdf6-875b-587b-88aa-90fc8672294e with identifier: KT36384
2026-03-30 05:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8496fdf6-875b-587b-88aa-90fc8672294e with scrape type 2
2026-03-30 05:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8496fdf6-875b-587b-88aa-90fc8672294e with scrape type 2
2026-03-30 05:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8496fdf6-875b-587b-88aa-90fc8672294e, identifier: KT36384
2026-03-30 05:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8496fdf6-875b-587b-88aa-90fc8672294e with identifier: KT36384
2026-03-30 05:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8496fdf6-875b-587b-88aa-90fc8672294e with identifier: KT36384
2026-03-30 05:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8496fdf6-875b-587b-88aa-90fc8672294e with identifier: KT36384 to the API
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:55Z',
 'fuel_type': 'diesel',
 'id': '8496fdf6-875b-587b-88aa-90fc8672294e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT36384',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 234445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Sportline 4Motion',
 'transmission': 'manual',
 'trim': 'Sportline 4Motion',
 'year': 2006}
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Saving data for KT36384: {'auction_closing_time': 1774883575.0, 'created_time': 1774638193.088486, 'last_price_update_time': 1774849228.540296}
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT36384') HTTP/1.1" 204 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for ZJ64916: 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-30 05:40:28 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Scrape type for FU12915: 2
2026-03-30 05:40:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71806947-4547-5666-9a9d-99b3b6db964c with identifier: FU12915
2026-03-30 05:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71806947-4547-5666-9a9d-99b3b6db964c with scrape type 2
2026-03-30 05:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71806947-4547-5666-9a9d-99b3b6db964c with scrape type 2
2026-03-30 05:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71806947-4547-5666-9a9d-99b3b6db964c, identifier: FU12915
2026-03-30 05:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71806947-4547-5666-9a9d-99b3b6db964c with identifier: FU12915
2026-03-30 05:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71806947-4547-5666-9a9d-99b3b6db964c with identifier: FU12915
2026-03-30 05:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71806947-4547-5666-9a9d-99b3b6db964c with identifier: FU12915 to the API
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'petrol',
 'id': '71806947-4547-5666-9a9d-99b3b6db964c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU12915',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 98974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2017}
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-30 05:40:28 [auto1.de] INFO: Saving data for FU12915: {'auction_closing_time': 1774884277.0, 'created_time': 1774032714.687337, 'last_price_update_time': 1774849228.997711}
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU12915') HTTP/1.1" 204 0
2026-03-30 05:40:29 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-30 05:40:29 [auto1.de] INFO: Scrape type for BU81814: 2
2026-03-30 05:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60811ae4-6449-53ab-b53e-b4b5ec1d480e with identifier: BU81814
2026-03-30 05:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60811ae4-6449-53ab-b53e-b4b5ec1d480e with scrape type 2
2026-03-30 05:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60811ae4-6449-53ab-b53e-b4b5ec1d480e with scrape type 2
2026-03-30 05:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60811ae4-6449-53ab-b53e-b4b5ec1d480e, identifier: BU81814
2026-03-30 05:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60811ae4-6449-53ab-b53e-b4b5ec1d480e with identifier: BU81814
2026-03-30 05:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60811ae4-6449-53ab-b53e-b4b5ec1d480e with identifier: BU81814
2026-03-30 05:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60811ae4-6449-53ab-b53e-b4b5ec1d480e with identifier: BU81814 to the API
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:18Z',
 'fuel_type': 'petrol',
 'id': '60811ae4-6449-53ab-b53e-b4b5ec1d480e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU81814',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 67124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-30 05:40:29 [auto1.de] INFO: Saving data for BU81814: {'auction_closing_time': 1774885458.0, 'created_time': 1774639148.243637, 'last_price_update_time': 1774849229.489109}
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU81814') HTTP/1.1" 204 0
2026-03-30 05:40:29 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-30 05:40:29 [auto1.de] INFO: Scrape type for WT92712: 2
2026-03-30 05:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-30 05:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2105802f-56d9-5452-bcf1-7b16a03d5338 with scrape type 2
2026-03-30 05:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2105802f-56d9-5452-bcf1-7b16a03d5338 with scrape type 2
2026-03-30 05:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2105802f-56d9-5452-bcf1-7b16a03d5338, identifier: WT92712
2026-03-30 05:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-30 05:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712
2026-03-30 05:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2105802f-56d9-5452-bcf1-7b16a03d5338 with identifier: WT92712 to the API
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'petrol',
 'id': '2105802f-56d9-5452-bcf1-7b16a03d5338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT92712',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 185851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-20',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2015}
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-30 05:40:29 [auto1.de] INFO: Saving data for WT92712: {'auction_closing_time': 1774883049.0, 'created_time': 1774551210.541408, 'last_price_update_time': 1774849229.896086}
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT92712') HTTP/1.1" 204 0
2026-03-30 05:40:29 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-30 05:40:29 [auto1.de] INFO: Scrape type for WJ73657: 2
2026-03-30 05:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09b5d569-209f-5fb2-badf-152db85ee336 with identifier: WJ73657
2026-03-30 05:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09b5d569-209f-5fb2-badf-152db85ee336 with scrape type 2
2026-03-30 05:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09b5d569-209f-5fb2-badf-152db85ee336 with scrape type 2
2026-03-30 05:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09b5d569-209f-5fb2-badf-152db85ee336, identifier: WJ73657
2026-03-30 05:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09b5d569-209f-5fb2-badf-152db85ee336 with identifier: WJ73657
2026-03-30 05:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09b5d569-209f-5fb2-badf-152db85ee336 with identifier: WJ73657
2026-03-30 05:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09b5d569-209f-5fb2-badf-152db85ee336 with identifier: WJ73657 to the API
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:53Z',
 'fuel_type': 'diesel',
 'id': '09b5d569-209f-5fb2-badf-152db85ee336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ73657',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 152318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-30 05:40:30 [auto1.de] INFO: Saving data for WJ73657: {'auction_closing_time': 1774885073.0, 'created_time': 1774002145.404006, 'last_price_update_time': 1774849230.317432}
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ73657') HTTP/1.1" 204 0
2026-03-30 05:40:30 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-30 05:40:30 [auto1.de] INFO: Scrape type for HP00850: 0
2026-03-30 05:40:30 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-30 05:40:30 [auto1.de] INFO: Scrape type for JU65331: 2
2026-03-30 05:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6090cd-1668-5772-9baa-018a8cba729a with identifier: JU65331
2026-03-30 05:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6090cd-1668-5772-9baa-018a8cba729a with scrape type 2
2026-03-30 05:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6090cd-1668-5772-9baa-018a8cba729a with scrape type 2
2026-03-30 05:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae6090cd-1668-5772-9baa-018a8cba729a, identifier: JU65331
2026-03-30 05:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae6090cd-1668-5772-9baa-018a8cba729a with identifier: JU65331
2026-03-30 05:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae6090cd-1668-5772-9baa-018a8cba729a with identifier: JU65331
2026-03-30 05:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae6090cd-1668-5772-9baa-018a8cba729a with identifier: JU65331 to the API
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'diesel',
 'id': 'ae6090cd-1668-5772-9baa-018a8cba729a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU65331',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 149979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-07',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-30 05:40:30 [auto1.de] INFO: Saving data for JU65331: {'auction_closing_time': 1774884678.0, 'created_time': 1773660648.369279, 'last_price_update_time': 1774849230.731732}
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU65331') HTTP/1.1" 204 0
2026-03-30 05:40:30 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:30 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-30 05:40:30 [auto1.de] INFO: Scrape type for ZL30155: 2
2026-03-30 05:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1122821-ad26-5ee4-aa34-44817701dee4 with identifier: ZL30155
2026-03-30 05:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1122821-ad26-5ee4-aa34-44817701dee4 with scrape type 2
2026-03-30 05:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1122821-ad26-5ee4-aa34-44817701dee4 with scrape type 2
2026-03-30 05:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1122821-ad26-5ee4-aa34-44817701dee4, identifier: ZL30155
2026-03-30 05:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1122821-ad26-5ee4-aa34-44817701dee4 with identifier: ZL30155
2026-03-30 05:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1122821-ad26-5ee4-aa34-44817701dee4 with identifier: ZL30155
2026-03-30 05:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1122821-ad26-5ee4-aa34-44817701dee4 with identifier: ZL30155 to the API
2026-03-30 05:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:16:21Z',
 'fuel_type': 'diesel',
 'id': 'f1122821-ad26-5ee4-aa34-44817701dee4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL30155',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 21705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-20',
 'seller_name': None,
 'title': 'BMW 5er 530d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-30 05:40:31 [auto1.de] INFO: Saving data for ZL30155: {'auction_closing_time': 1774883781.0, 'created_time': 1773946147.333687, 'last_price_update_time': 1774849231.505524}
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL30155') HTTP/1.1" 204 0
2026-03-30 05:40:31 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 05:40:31 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-30 05:40:31 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-30 05:40:31 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-30 05:40:31 [auto1.de] INFO: Scrape type for RZ09497: 2
2026-03-30 05:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48ee7e8c-29b1-543d-b30c-ccabcce5128a with identifier: RZ09497
2026-03-30 05:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48ee7e8c-29b1-543d-b30c-ccabcce5128a with scrape type 2
2026-03-30 05:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48ee7e8c-29b1-543d-b30c-ccabcce5128a with scrape type 2
2026-03-30 05:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48ee7e8c-29b1-543d-b30c-ccabcce5128a, identifier: RZ09497
2026-03-30 05:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:31 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-30 05:40:31 [auto1.de] INFO: Scrape type for DK81331: 2
2026-03-30 05:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-30 05:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b94a30-9c44-5394-9c9b-62a6f7984fed with scrape type 2
2026-03-30 05:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b94a30-9c44-5394-9c9b-62a6f7984fed with scrape type 2
2026-03-30 05:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b94a30-9c44-5394-9c9b-62a6f7984fed, identifier: DK81331
2026-03-30 05:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48ee7e8c-29b1-543d-b30c-ccabcce5128a with identifier: RZ09497
2026-03-30 05:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48ee7e8c-29b1-543d-b30c-ccabcce5128a with identifier: RZ09497
2026-03-30 05:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48ee7e8c-29b1-543d-b30c-ccabcce5128a with identifier: RZ09497 to the API
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:15:45Z',
 'fuel_type': 'petrol',
 'id': '48ee7e8c-29b1-543d-b30c-ccabcce5128a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ09497',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 90717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-10',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-30 05:40:32 [auto1.de] INFO: Saving data for RZ09497: {'auction_closing_time': 1774883745.0, 'created_time': 1774639398.276939, 'last_price_update_time': 1774849232.068182}
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ09497') HTTP/1.1" 204 0
2026-03-30 05:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-30 05:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331
2026-03-30 05:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b94a30-9c44-5394-9c9b-62a6f7984fed with identifier: DK81331 to the API
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:42Z',
 'fuel_type': 'petrol',
 'id': 'c9b94a30-9c44-5394-9c9b-62a6f7984fed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK81331',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 101580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-30 05:40:32 [auto1.de] INFO: Saving data for DK81331: {'auction_closing_time': 1774883502.0, 'created_time': 1774550288.341359, 'last_price_update_time': 1774849232.354114}
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK81331') HTTP/1.1" 204 0
2026-03-30 05:40:32 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-30 05:40:32 [auto1.de] INFO: Scrape type for LF01905: 2
2026-03-30 05:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-30 05:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcfe3c40-609e-5262-9fb5-17c812e76e39 with scrape type 2
2026-03-30 05:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcfe3c40-609e-5262-9fb5-17c812e76e39 with scrape type 2
2026-03-30 05:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcfe3c40-609e-5262-9fb5-17c812e76e39, identifier: LF01905
2026-03-30 05:40:33 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-30 05:40:33 [auto1.de] INFO: Scrape type for ZG14891: 2
2026-03-30 05:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8c78193-02b6-53be-b2d7-bcb66a58b049 with identifier: ZG14891
2026-03-30 05:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8c78193-02b6-53be-b2d7-bcb66a58b049 with scrape type 2
2026-03-30 05:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8c78193-02b6-53be-b2d7-bcb66a58b049 with scrape type 2
2026-03-30 05:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8c78193-02b6-53be-b2d7-bcb66a58b049, identifier: ZG14891
2026-03-30 05:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-30 05:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905
2026-03-30 05:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcfe3c40-609e-5262-9fb5-17c812e76e39 with identifier: LF01905 to the API
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:55:17Z',
 'fuel_type': 'petrol',
 'id': 'bcfe3c40-609e-5262-9fb5-17c812e76e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF01905',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 114748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-26',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-30 05:40:33 [auto1.de] INFO: Saving data for LF01905: {'auction_closing_time': 1774886117.0, 'created_time': 1774550668.677025, 'last_price_update_time': 1774849233.644301}
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF01905') HTTP/1.1" 204 0
2026-03-30 05:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8c78193-02b6-53be-b2d7-bcb66a58b049 with identifier: ZG14891
2026-03-30 05:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8c78193-02b6-53be-b2d7-bcb66a58b049 with identifier: ZG14891
2026-03-30 05:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8c78193-02b6-53be-b2d7-bcb66a58b049 with identifier: ZG14891 to the API
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:07:01Z',
 'fuel_type': 'petrol',
 'id': 'a8c78193-02b6-53be-b2d7-bcb66a58b049',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG14891',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 163797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Saving data for ZG14891: {'auction_closing_time': 1774883221.0, 'created_time': 1774349713.133114, 'last_price_update_time': 1774849234.02825}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG14891') HTTP/1.1" 204 0
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Scrape type for TW44839: 2
2026-03-30 05:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-30 05:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with scrape type 2
2026-03-30 05:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with scrape type 2
2026-03-30 05:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8617e3c-1f1a-5b78-8f42-c3daa1790a37, identifier: TW44839
2026-03-30 05:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-30 05:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839
2026-03-30 05:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8617e3c-1f1a-5b78-8f42-c3daa1790a37 with identifier: TW44839 to the API
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:32:55Z',
 'fuel_type': 'diesel',
 'id': 'd8617e3c-1f1a-5b78-8f42-c3daa1790a37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44839',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 119919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-04',
 'seller_name': None,
 'title': 'BMW 2er 220d Active Tourer xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2015}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Saving data for TW44839: {'auction_closing_time': 1774884775.0, 'created_time': 1773946476.629335, 'last_price_update_time': 1774849234.497444}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW44839') HTTP/1.1" 204 0
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Scrape type for UJ17280: 2
2026-03-30 05:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d491a1-2ae8-5420-8968-4eae164073ae with identifier: UJ17280
2026-03-30 05:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d491a1-2ae8-5420-8968-4eae164073ae with scrape type 2
2026-03-30 05:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d491a1-2ae8-5420-8968-4eae164073ae with scrape type 2
2026-03-30 05:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d491a1-2ae8-5420-8968-4eae164073ae, identifier: UJ17280
2026-03-30 05:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d491a1-2ae8-5420-8968-4eae164073ae with identifier: UJ17280
2026-03-30 05:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d491a1-2ae8-5420-8968-4eae164073ae with identifier: UJ17280
2026-03-30 05:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d491a1-2ae8-5420-8968-4eae164073ae with identifier: UJ17280 to the API
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:47:39Z',
 'fuel_type': 'diesel',
 'id': '23d491a1-2ae8-5420-8968-4eae164073ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ17280',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 96759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-28',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Saving data for UJ17280: {'auction_closing_time': 1774885659.0, 'created_time': 1773227719.060832, 'last_price_update_time': 1774849234.918511}
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ17280') HTTP/1.1" 204 0
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Scrape type for HX15626: 0
2026-03-30 05:40:34 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-30 05:40:34 [auto1.de] INFO: Scrape type for YX12921: 2
2026-03-30 05:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d029103b-d4f7-5a24-9855-76ecb11dc530 with identifier: YX12921
2026-03-30 05:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d029103b-d4f7-5a24-9855-76ecb11dc530 with scrape type 2
2026-03-30 05:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d029103b-d4f7-5a24-9855-76ecb11dc530 with scrape type 2
2026-03-30 05:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d029103b-d4f7-5a24-9855-76ecb11dc530, identifier: YX12921
2026-03-30 05:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d029103b-d4f7-5a24-9855-76ecb11dc530 with identifier: YX12921
2026-03-30 05:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d029103b-d4f7-5a24-9855-76ecb11dc530 with identifier: YX12921
2026-03-30 05:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d029103b-d4f7-5a24-9855-76ecb11dc530 with identifier: YX12921 to the API
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:18Z',
 'fuel_type': 'petrol',
 'id': 'd029103b-d4f7-5a24-9855-76ecb11dc530',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX12921',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 69776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-19',
 'seller_name': None,
 'title': 'Jeep Renegade 1.4 M-Air Limited FWD',
 'transmission': 'automatic',
 'trim': 'Limited FWD',
 'year': 2018}
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-30 05:40:35 [auto1.de] INFO: Saving data for YX12921: {'auction_closing_time': 1774885818.0, 'created_time': 1773917155.645441, 'last_price_update_time': 1774849235.322054}
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX12921') HTTP/1.1" 204 0
2026-03-30 05:40:35 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-30 05:40:35 [auto1.de] INFO: Scrape type for LK21356: 2
2026-03-30 05:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58787df2-00b6-5737-b0ed-429c755bfe70 with identifier: LK21356
2026-03-30 05:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58787df2-00b6-5737-b0ed-429c755bfe70 with scrape type 2
2026-03-30 05:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58787df2-00b6-5737-b0ed-429c755bfe70 with scrape type 2
2026-03-30 05:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58787df2-00b6-5737-b0ed-429c755bfe70, identifier: LK21356
2026-03-30 05:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58787df2-00b6-5737-b0ed-429c755bfe70 with identifier: LK21356
2026-03-30 05:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58787df2-00b6-5737-b0ed-429c755bfe70 with identifier: LK21356
2026-03-30 05:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58787df2-00b6-5737-b0ed-429c755bfe70 with identifier: LK21356 to the API
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:36:17Z',
 'fuel_type': 'petrol',
 'id': '58787df2-00b6-5737-b0ed-429c755bfe70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK21356',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 73837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-30 05:40:35 [auto1.de] INFO: Saving data for LK21356: {'auction_closing_time': 1774884977.0, 'created_time': 1774639272.869643, 'last_price_update_time': 1774849235.723705}
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK21356') HTTP/1.1" 204 0
2026-03-30 05:40:35 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-30 05:40:35 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-30 05:40:35 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-30 05:40:35 [auto1.de] INFO: Scrape type for RL20580: 2
2026-03-30 05:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-30 05:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with scrape type 2
2026-03-30 05:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with scrape type 2
2026-03-30 05:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c, identifier: RL20580
2026-03-30 05:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-30 05:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580
2026-03-30 05:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c with identifier: RL20580 to the API
2026-03-30 05:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:48Z',
 'fuel_type': 'petrol',
 'id': '3d3e6935-eb44-5a28-bd7d-fa35cdc7ca8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL20580',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 107218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-01',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2015}
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-30 05:40:36 [auto1.de] INFO: Saving data for RL20580: {'auction_closing_time': 1774883808.0, 'created_time': 1774552826.236594, 'last_price_update_time': 1774849236.159617}
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL20580') HTTP/1.1" 204 0
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-30 05:40:36 [auto1.de] INFO: Scrape type for AX39550: 2
2026-03-30 05:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-30 05:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47de7419-97f6-5517-9720-5b2a0a1603e9 with scrape type 2
2026-03-30 05:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47de7419-97f6-5517-9720-5b2a0a1603e9 with scrape type 2
2026-03-30 05:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47de7419-97f6-5517-9720-5b2a0a1603e9, identifier: AX39550
2026-03-30 05:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-30 05:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550
2026-03-30 05:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47de7419-97f6-5517-9720-5b2a0a1603e9 with identifier: AX39550 to the API
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:46:24Z',
 'fuel_type': 'petrol',
 'id': '47de7419-97f6-5517-9720-5b2a0a1603e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX39550',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 123093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-20',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2014}
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-30 05:40:36 [auto1.de] INFO: Saving data for AX39550: {'auction_closing_time': 1774885584.0, 'created_time': 1774550606.180922, 'last_price_update_time': 1774849236.634098}
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX39550') HTTP/1.1" 204 0
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-30 05:40:36 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-30 05:40:36 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-30 05:40:36 [auto1.de] INFO: Scrape type for JT67031: 2
2026-03-30 05:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-30 05:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with scrape type 2
2026-03-30 05:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with scrape type 2
2026-03-30 05:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139, identifier: JT67031
2026-03-30 05:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-30 05:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031
2026-03-30 05:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139 with identifier: JT67031 to the API
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:43:07Z',
 'fuel_type': 'petrol',
 'id': '95c13a8d-a0ad-5dfd-a8bf-a3c3fb707139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT67031',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 43126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2018}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Saving data for JT67031: {'auction_closing_time': 1774885387.0, 'created_time': 1774551856.33581, 'last_price_update_time': 1774849237.038356}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT67031') HTTP/1.1" 204 0
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Scrape type for MA51695: 2
2026-03-30 05:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-30 05:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with scrape type 2
2026-03-30 05:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with scrape type 2
2026-03-30 05:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8, identifier: MA51695
2026-03-30 05:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-30 05:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695
2026-03-30 05:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 706f56ec-7936-5a06-a36f-b8a1e7db8ec8 with identifier: MA51695 to the API
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'petrol',
 'id': '706f56ec-7936-5a06-a36f-b8a1e7db8ec8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA51695',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 13401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-12',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Saving data for MA51695: {'auction_closing_time': 1774886010.0, 'created_time': 1774552655.806883, 'last_price_update_time': 1774849237.433574}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA51695') HTTP/1.1" 204 0
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Scrape type for VL78522: 2
2026-03-30 05:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-30 05:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0303fe60-6d6d-510d-bd82-f60a02aa7341 with scrape type 2
2026-03-30 05:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0303fe60-6d6d-510d-bd82-f60a02aa7341 with scrape type 2
2026-03-30 05:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0303fe60-6d6d-510d-bd82-f60a02aa7341, identifier: VL78522
2026-03-30 05:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-30 05:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522
2026-03-30 05:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0303fe60-6d6d-510d-bd82-f60a02aa7341 with identifier: VL78522 to the API
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': '0303fe60-6d6d-510d-bd82-f60a02aa7341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL78522',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 80039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Smart forfour 0.9 Turbo Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Saving data for VL78522: {'auction_closing_time': 1774885242.0, 'created_time': 1774552964.218711, 'last_price_update_time': 1774849237.836974}
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL78522') HTTP/1.1" 204 0
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-30 05:40:37 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-30 05:40:37 [auto1.de] INFO: Scrape type for FU90427: 2
2026-03-30 05:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with identifier: FU90427
2026-03-30 05:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with scrape type 2
2026-03-30 05:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with scrape type 2
2026-03-30 05:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8fb5f13-aa18-5ca5-80f1-a9871a8676d2, identifier: FU90427
2026-03-30 05:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with identifier: FU90427
2026-03-30 05:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with identifier: FU90427
2026-03-30 05:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8fb5f13-aa18-5ca5-80f1-a9871a8676d2 with identifier: FU90427 to the API
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:40Z',
 'fuel_type': 'diesel',
 'id': 'b8fb5f13-aa18-5ca5-80f1-a9871a8676d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU90427',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 182541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2015}
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-30 05:40:38 [auto1.de] INFO: Saving data for FU90427: {'auction_closing_time': 1774885240.0, 'created_time': 1774639443.34072, 'last_price_update_time': 1774849238.348704}
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU90427') HTTP/1.1" 204 0
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-30 05:40:38 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-30 05:40:38 [auto1.de] INFO: Scrape type for LJ75768: 2
2026-03-30 05:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 842961a0-3fa7-5860-bfb8-7d46d923b51a with identifier: LJ75768
2026-03-30 05:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 842961a0-3fa7-5860-bfb8-7d46d923b51a with scrape type 2
2026-03-30 05:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 842961a0-3fa7-5860-bfb8-7d46d923b51a with scrape type 2
2026-03-30 05:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 842961a0-3fa7-5860-bfb8-7d46d923b51a, identifier: LJ75768
2026-03-30 05:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 842961a0-3fa7-5860-bfb8-7d46d923b51a with identifier: LJ75768
2026-03-30 05:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 842961a0-3fa7-5860-bfb8-7d46d923b51a with identifier: LJ75768
2026-03-30 05:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 842961a0-3fa7-5860-bfb8-7d46d923b51a with identifier: LJ75768 to the API
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:59Z',
 'fuel_type': 'diesel',
 'id': '842961a0-3fa7-5860-bfb8-7d46d923b51a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ75768',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 171010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2011}
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-30 05:40:38 [auto1.de] INFO: Saving data for LJ75768: {'auction_closing_time': 1774884179.0, 'created_time': 1774337431.145888, 'last_price_update_time': 1774849238.770989}
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ75768') HTTP/1.1" 204 0
2026-03-30 05:40:38 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 05:40:38 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-30 05:40:38 [auto1.de] INFO: Scrape type for MH37188: 2
2026-03-30 05:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 021077c0-56f3-591e-b4d6-087a4db9a3f9 with identifier: MH37188
2026-03-30 05:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 021077c0-56f3-591e-b4d6-087a4db9a3f9 with scrape type 2
2026-03-30 05:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 021077c0-56f3-591e-b4d6-087a4db9a3f9 with scrape type 2
2026-03-30 05:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 021077c0-56f3-591e-b4d6-087a4db9a3f9, identifier: MH37188
2026-03-30 05:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 021077c0-56f3-591e-b4d6-087a4db9a3f9 with identifier: MH37188
2026-03-30 05:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 021077c0-56f3-591e-b4d6-087a4db9a3f9 with identifier: MH37188
2026-03-30 05:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 021077c0-56f3-591e-b4d6-087a4db9a3f9 with identifier: MH37188 to the API
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'diesel',
 'id': '021077c0-56f3-591e-b4d6-087a4db9a3f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH37188',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 255732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'manual',
 'trim': 'Scout 4x4',
 'year': 2011}
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Saving data for MH37188: {'auction_closing_time': 1774883189.0, 'created_time': 1774032782.849651, 'last_price_update_time': 1774849239.224431}
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH37188') HTTP/1.1" 204 0
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for PC91683: 0
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for HD47083: 0
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for GN50102: 2
2026-03-30 05:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fd65dc-752f-5b4f-9de9-4810a1802283 with identifier: GN50102
2026-03-30 05:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fd65dc-752f-5b4f-9de9-4810a1802283 with scrape type 2
2026-03-30 05:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98fd65dc-752f-5b4f-9de9-4810a1802283 with scrape type 2
2026-03-30 05:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98fd65dc-752f-5b4f-9de9-4810a1802283, identifier: GN50102
2026-03-30 05:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for SJ79213: 0
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-30 05:40:39 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Scrape type for GM12066: 2
2026-03-30 05:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e42e24fc-bfdf-5e41-b43d-a31305d4e074 with identifier: GM12066
2026-03-30 05:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e42e24fc-bfdf-5e41-b43d-a31305d4e074 with scrape type 2
2026-03-30 05:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e42e24fc-bfdf-5e41-b43d-a31305d4e074 with scrape type 2
2026-03-30 05:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e42e24fc-bfdf-5e41-b43d-a31305d4e074, identifier: GM12066
2026-03-30 05:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98fd65dc-752f-5b4f-9de9-4810a1802283 with identifier: GN50102
2026-03-30 05:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98fd65dc-752f-5b4f-9de9-4810a1802283 with identifier: GN50102
2026-03-30 05:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98fd65dc-752f-5b4f-9de9-4810a1802283 with identifier: GN50102 to the API
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:54:41Z',
 'fuel_type': 'petrol',
 'id': '98fd65dc-752f-5b4f-9de9-4810a1802283',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN50102',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 144020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-30 05:40:39 [auto1.de] INFO: Saving data for GN50102: {'auction_closing_time': 1774886081.0, 'created_time': 1774637775.22106, 'last_price_update_time': 1774849239.797101}
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN50102') HTTP/1.1" 204 0
2026-03-30 05:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e42e24fc-bfdf-5e41-b43d-a31305d4e074 with identifier: GM12066
2026-03-30 05:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e42e24fc-bfdf-5e41-b43d-a31305d4e074 with identifier: GM12066
2026-03-30 05:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e42e24fc-bfdf-5e41-b43d-a31305d4e074 with identifier: GM12066 to the API
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:55:00Z',
 'fuel_type': 'petrol',
 'id': 'e42e24fc-bfdf-5e41-b43d-a31305d4e074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM12066',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 131613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-01',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Saving data for GM12066: {'auction_closing_time': 1774886100.0, 'created_time': 1773307956.268469, 'last_price_update_time': 1774849240.231783}
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM12066') HTTP/1.1" 204 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for XW56933: 2
2026-03-30 05:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with identifier: XW56933
2026-03-30 05:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with scrape type 2
2026-03-30 05:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with scrape type 2
2026-03-30 05:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e, identifier: XW56933
2026-03-30 05:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with identifier: XW56933
2026-03-30 05:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with identifier: XW56933
2026-03-30 05:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e with identifier: XW56933 to the API
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:45:31Z',
 'fuel_type': 'petrol',
 'id': '189a4e6b-d89e-53b4-b3b2-8ad4ce24bb4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW56933',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 199461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Saving data for XW56933: {'auction_closing_time': 1774885531.0, 'created_time': 1772545286.337582, 'last_price_update_time': 1774849240.677978}
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW56933') HTTP/1.1" 204 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for MA63217: 0
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-30 05:40:40 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-30 05:40:40 [auto1.de] INFO: Scrape type for LW05271: 2
2026-03-30 05:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ffd9a6-9544-521e-bb87-b575d0c5d332 with identifier: LW05271
2026-03-30 05:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ffd9a6-9544-521e-bb87-b575d0c5d332 with scrape type 2
2026-03-30 05:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40ffd9a6-9544-521e-bb87-b575d0c5d332 with scrape type 2
2026-03-30 05:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40ffd9a6-9544-521e-bb87-b575d0c5d332, identifier: LW05271
2026-03-30 05:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40ffd9a6-9544-521e-bb87-b575d0c5d332 with identifier: LW05271
2026-03-30 05:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40ffd9a6-9544-521e-bb87-b575d0c5d332 with identifier: LW05271
2026-03-30 05:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40ffd9a6-9544-521e-bb87-b575d0c5d332 with identifier: LW05271 to the API
2026-03-30 05:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:13Z',
 'fuel_type': 'diesel',
 'id': '40ffd9a6-9544-521e-bb87-b575d0c5d332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW05271',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 212186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2017}
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Saving data for LW05271: {'auction_closing_time': 1774884253.0, 'created_time': 1774639423.678913, 'last_price_update_time': 1774849241.11616}
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW05271') HTTP/1.1" 204 0
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Scrape type for DE59201: 0
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Scrape type for XK18770: 0
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Scrape type for UD63369: 2
2026-03-30 05:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-30 05:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with scrape type 2
2026-03-30 05:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with scrape type 2
2026-03-30 05:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45cc50fc-0541-5bc7-9635-156f87a5d7c6, identifier: UD63369
2026-03-30 05:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-30 05:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369
2026-03-30 05:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45cc50fc-0541-5bc7-9635-156f87a5d7c6 with identifier: UD63369 to the API
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:09Z',
 'fuel_type': 'diesel',
 'id': '45cc50fc-0541-5bc7-9635-156f87a5d7c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD63369',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 128211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Saving data for UD63369: {'auction_closing_time': 1774885989.0, 'created_time': 1774550663.756162, 'last_price_update_time': 1774849241.667084}
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD63369') HTTP/1.1" 204 0
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-30 05:40:41 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-30 05:40:41 [auto1.de] INFO: Scrape type for XP95900: 2
2026-03-30 05:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-30 05:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with scrape type 2
2026-03-30 05:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with scrape type 2
2026-03-30 05:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d247e7-0d6b-5b25-ad99-eab54a1f5825, identifier: XP95900
2026-03-30 05:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-30 05:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900
2026-03-30 05:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d247e7-0d6b-5b25-ad99-eab54a1f5825 with identifier: XP95900 to the API
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:52:17Z',
 'fuel_type': 'petrol',
 'id': 'c4d247e7-0d6b-5b25-ad99-eab54a1f5825',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP95900',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 183328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Saving data for XP95900: {'auction_closing_time': 1774885937.0, 'created_time': 1773917351.096327, 'last_price_update_time': 1774849242.093215}
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP95900') HTTP/1.1" 204 0
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Scrape type for ND25281: 0
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Scrape type for HZ16106: 2
2026-03-30 05:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c319482-02d0-5147-ade5-4786c4eecb38 with identifier: HZ16106
2026-03-30 05:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c319482-02d0-5147-ade5-4786c4eecb38 with scrape type 2
2026-03-30 05:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c319482-02d0-5147-ade5-4786c4eecb38 with scrape type 2
2026-03-30 05:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c319482-02d0-5147-ade5-4786c4eecb38, identifier: HZ16106
2026-03-30 05:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c319482-02d0-5147-ade5-4786c4eecb38 with identifier: HZ16106
2026-03-30 05:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c319482-02d0-5147-ade5-4786c4eecb38 with identifier: HZ16106
2026-03-30 05:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c319482-02d0-5147-ade5-4786c4eecb38 with identifier: HZ16106 to the API
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:48:57Z',
 'fuel_type': 'petrol',
 'id': '8c319482-02d0-5147-ade5-4786c4eecb38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ16106',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 363051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Life Gewinner Caddy',
 'transmission': 'manual',
 'trim': 'Life Gewinner',
 'year': 2009}
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Saving data for HZ16106: {'auction_closing_time': 1774885737.0, 'created_time': 1774639467.982706, 'last_price_update_time': 1774849242.51603}
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ16106') HTTP/1.1" 204 0
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-30 05:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:42 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-30 05:40:42 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-30 05:40:42 [auto1.de] INFO: Scrape type for SC73852: 2
2026-03-30 05:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-30 05:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with scrape type 2
2026-03-30 05:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with scrape type 2
2026-03-30 05:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2, identifier: SC73852
2026-03-30 05:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-30 05:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852
2026-03-30 05:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2 with identifier: SC73852 to the API
2026-03-30 05:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:26:56Z',
 'fuel_type': 'petrol',
 'id': '5a9a8ff6-dc3b-5371-a8a9-ec47b147cfd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC73852',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 123979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2010}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Saving data for SC73852: {'auction_closing_time': 1774884416.0, 'created_time': 1774552446.418803, 'last_price_update_time': 1774849243.146613}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC73852') HTTP/1.1" 204 0
2026-03-30 05:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:43 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-30 05:40:43 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-30 05:40:43 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Scrape type for AU06987: 2
2026-03-30 05:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with identifier: AU06987
2026-03-30 05:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with scrape type 2
2026-03-30 05:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with scrape type 2
2026-03-30 05:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca, identifier: AU06987
2026-03-30 05:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with identifier: AU06987
2026-03-30 05:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with identifier: AU06987
2026-03-30 05:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca with identifier: AU06987 to the API
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:53:32Z',
 'fuel_type': 'diesel',
 'id': 'f1df4f38-4d3e-5d2d-a7aa-de9cc04ef3ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU06987',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 212538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Saving data for AU06987: {'auction_closing_time': 1774886012.0, 'created_time': 1774637281.390211, 'last_price_update_time': 1774849243.529995}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU06987') HTTP/1.1" 204 0
2026-03-30 05:40:43 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Scrape type for SX98211: 2
2026-03-30 05:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-30 05:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03a1f826-522b-5428-8f32-a4be4625dfcd with scrape type 2
2026-03-30 05:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03a1f826-522b-5428-8f32-a4be4625dfcd with scrape type 2
2026-03-30 05:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03a1f826-522b-5428-8f32-a4be4625dfcd, identifier: SX98211
2026-03-30 05:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-30 05:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211
2026-03-30 05:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03a1f826-522b-5428-8f32-a4be4625dfcd with identifier: SX98211 to the API
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:15:46Z',
 'fuel_type': 'petrol',
 'id': '03a1f826-522b-5428-8f32-a4be4625dfcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX98211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 108228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Saving data for SX98211: {'auction_closing_time': 1774883746.0, 'created_time': 1774552440.302758, 'last_price_update_time': 1774849243.921025}
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX98211') HTTP/1.1" 204 0
2026-03-30 05:40:43 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-30 05:40:43 [auto1.de] INFO: Scrape type for SL60481: 2
2026-03-30 05:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8711fb20-42a8-5956-924a-1b4ca9c6d36b with identifier: SL60481
2026-03-30 05:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8711fb20-42a8-5956-924a-1b4ca9c6d36b with scrape type 2
2026-03-30 05:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8711fb20-42a8-5956-924a-1b4ca9c6d36b with scrape type 2
2026-03-30 05:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8711fb20-42a8-5956-924a-1b4ca9c6d36b, identifier: SL60481
2026-03-30 05:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8711fb20-42a8-5956-924a-1b4ca9c6d36b with identifier: SL60481
2026-03-30 05:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8711fb20-42a8-5956-924a-1b4ca9c6d36b with identifier: SL60481
2026-03-30 05:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8711fb20-42a8-5956-924a-1b4ca9c6d36b with identifier: SL60481 to the API
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:46Z',
 'fuel_type': 'petrol',
 'id': '8711fb20-42a8-5956-924a-1b4ca9c6d36b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL60481',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 32313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-12',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Saving data for SL60481: {'auction_closing_time': 1774883326.0, 'created_time': 1774034484.275144, 'last_price_update_time': 1774849244.332225}
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL60481') HTTP/1.1" 204 0
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Scrape type for VE41795: 2
2026-03-30 05:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a042efb6-239f-5694-82b6-d0f3dd2791fe with identifier: VE41795
2026-03-30 05:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a042efb6-239f-5694-82b6-d0f3dd2791fe with scrape type 2
2026-03-30 05:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a042efb6-239f-5694-82b6-d0f3dd2791fe with scrape type 2
2026-03-30 05:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a042efb6-239f-5694-82b6-d0f3dd2791fe, identifier: VE41795
2026-03-30 05:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a042efb6-239f-5694-82b6-d0f3dd2791fe with identifier: VE41795
2026-03-30 05:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a042efb6-239f-5694-82b6-d0f3dd2791fe with identifier: VE41795
2026-03-30 05:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a042efb6-239f-5694-82b6-d0f3dd2791fe with identifier: VE41795 to the API
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:03:40Z',
 'fuel_type': 'diesel',
 'id': 'a042efb6-239f-5694-82b6-d0f3dd2791fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE41795',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 115371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Saving data for VE41795: {'auction_closing_time': 1774883020.0, 'created_time': 1774639206.203642, 'last_price_update_time': 1774849244.743724}
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE41795') HTTP/1.1" 204 0
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-30 05:40:44 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-30 05:40:44 [auto1.de] INFO: Scrape type for NH92244: 2
2026-03-30 05:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with identifier: NH92244
2026-03-30 05:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with scrape type 2
2026-03-30 05:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with scrape type 2
2026-03-30 05:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b63b37e-708a-5e6d-b7ad-3940f0f119eb, identifier: NH92244
2026-03-30 05:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with identifier: NH92244
2026-03-30 05:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with identifier: NH92244
2026-03-30 05:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b63b37e-708a-5e6d-b7ad-3940f0f119eb with identifier: NH92244 to the API
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:02:19Z',
 'fuel_type': 'petrol',
 'id': '9b63b37e-708a-5e6d-b7ad-3940f0f119eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH92244',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 63701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-10',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2006}
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-30 05:40:45 [auto1.de] INFO: Saving data for NH92244: {'auction_closing_time': 1774882939.0, 'created_time': 1774637220.174765, 'last_price_update_time': 1774849245.215811}
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH92244') HTTP/1.1" 204 0
2026-03-30 05:40:45 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-30 05:40:45 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-30 05:40:45 [auto1.de] INFO: Scrape type for PB97430: 2
2026-03-30 05:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f89a87f-f458-5ff5-86fb-53087bf57b6d with identifier: PB97430
2026-03-30 05:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f89a87f-f458-5ff5-86fb-53087bf57b6d with scrape type 2
2026-03-30 05:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f89a87f-f458-5ff5-86fb-53087bf57b6d with scrape type 2
2026-03-30 05:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f89a87f-f458-5ff5-86fb-53087bf57b6d, identifier: PB97430
2026-03-30 05:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f89a87f-f458-5ff5-86fb-53087bf57b6d with identifier: PB97430
2026-03-30 05:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f89a87f-f458-5ff5-86fb-53087bf57b6d with identifier: PB97430
2026-03-30 05:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f89a87f-f458-5ff5-86fb-53087bf57b6d with identifier: PB97430 to the API
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:53:05Z',
 'fuel_type': 'petrol',
 'id': '2f89a87f-f458-5ff5-86fb-53087bf57b6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB97430',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 215812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-30 05:40:45 [auto1.de] INFO: Saving data for PB97430: {'auction_closing_time': 1774885985.0, 'created_time': 1774637121.603092, 'last_price_update_time': 1774849245.714831}
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB97430') HTTP/1.1" 204 0
2026-03-30 05:40:45 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-30 05:40:45 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-30 05:40:45 [auto1.de] INFO: Scrape type for YY43681: 2
2026-03-30 05:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd9cde50-b3e3-5be0-9021-644fcec4a5ed with identifier: YY43681
2026-03-30 05:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd9cde50-b3e3-5be0-9021-644fcec4a5ed with scrape type 2
2026-03-30 05:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd9cde50-b3e3-5be0-9021-644fcec4a5ed with scrape type 2
2026-03-30 05:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd9cde50-b3e3-5be0-9021-644fcec4a5ed, identifier: YY43681
2026-03-30 05:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd9cde50-b3e3-5be0-9021-644fcec4a5ed with identifier: YY43681
2026-03-30 05:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd9cde50-b3e3-5be0-9021-644fcec4a5ed with identifier: YY43681
2026-03-30 05:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd9cde50-b3e3-5be0-9021-644fcec4a5ed with identifier: YY43681 to the API
2026-03-30 05:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:39:30Z',
 'fuel_type': 'petrol',
 'id': 'cd9cde50-b3e3-5be0-9021-644fcec4a5ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY43681',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 80557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-12',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 High up! BlueMotion',
 'transmission': 'manual',
 'trim': 'High  BlueMotion',
 'year': 2017}
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Saving data for YY43681: {'auction_closing_time': 1774885170.0, 'created_time': 1774638595.740323, 'last_price_update_time': 1774849246.14466}
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY43681') HTTP/1.1" 204 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for AW92068: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for FZ02715: 2
2026-03-30 05:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-03-30 05:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with scrape type 2
2026-03-30 05:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with scrape type 2
2026-03-30 05:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e, identifier: FZ02715
2026-03-30 05:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-03-30 05:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715
2026-03-30 05:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8b3da4c-b2e0-5e61-8b3b-d96b6121be0e with identifier: FZ02715 to the API
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:26Z',
 'fuel_type': 'diesel',
 'id': 'd8b3da4c-b2e0-5e61-8b3b-d96b6121be0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ02715',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 164597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2014}
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Saving data for FZ02715: {'auction_closing_time': 1774886366.0, 'created_time': 1774549876.855098, 'last_price_update_time': 1774849246.653892}
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ02715') HTTP/1.1" 204 0
2026-03-30 05:40:46 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-30 05:40:46 [auto1.de] INFO: Scrape type for ZJ20078: 2
2026-03-30 05:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-30 05:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9301628-71bd-55e5-9dce-82d4ff083f06 with scrape type 2
2026-03-30 05:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9301628-71bd-55e5-9dce-82d4ff083f06 with scrape type 2
2026-03-30 05:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9301628-71bd-55e5-9dce-82d4ff083f06, identifier: ZJ20078
2026-03-30 05:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-30 05:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078
2026-03-30 05:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9301628-71bd-55e5-9dce-82d4ff083f06 with identifier: ZJ20078 to the API
2026-03-30 05:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:14Z',
 'fuel_type': 'diesel',
 'id': 'd9301628-71bd-55e5-9dce-82d4ff083f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ20078',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 89089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2016}
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-30 05:40:47 [auto1.de] INFO: Saving data for ZJ20078: {'auction_closing_time': 1774884974.0, 'created_time': 1774675851.398027, 'last_price_update_time': 1774849247.154205}
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ20078') HTTP/1.1" 204 0
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-30 05:40:47 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-30 05:40:47 [auto1.de] INFO: Scrape type for KY02769: 2
2026-03-30 05:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdf0424f-d7f1-5821-ad9d-334fc341bdfe with identifier: KY02769
2026-03-30 05:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdf0424f-d7f1-5821-ad9d-334fc341bdfe with scrape type 2
2026-03-30 05:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdf0424f-d7f1-5821-ad9d-334fc341bdfe with scrape type 2
2026-03-30 05:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdf0424f-d7f1-5821-ad9d-334fc341bdfe, identifier: KY02769
2026-03-30 05:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdf0424f-d7f1-5821-ad9d-334fc341bdfe with identifier: KY02769
2026-03-30 05:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdf0424f-d7f1-5821-ad9d-334fc341bdfe with identifier: KY02769
2026-03-30 05:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdf0424f-d7f1-5821-ad9d-334fc341bdfe with identifier: KY02769 to the API
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 385,
 'expiration_date': '2026-03-30T15:08:17Z',
 'fuel_type': 'petrol',
 'id': 'fdf0424f-d7f1-5821-ad9d-334fc341bdfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY02769',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 150763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-25',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-30 05:40:47 [auto1.de] INFO: Saving data for KY02769: {'auction_closing_time': 1774883297.0, 'created_time': 1774639420.393377, 'last_price_update_time': 1774849247.581183}
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY02769') HTTP/1.1" 204 0
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-30 05:40:47 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 05:40:47 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-30 05:40:47 [auto1.de] INFO: Scrape type for WB37074: 2
2026-03-30 05:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-30 05:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3baa359f-fda7-52c2-be4b-625772968c3c with scrape type 2
2026-03-30 05:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3baa359f-fda7-52c2-be4b-625772968c3c with scrape type 2
2026-03-30 05:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3baa359f-fda7-52c2-be4b-625772968c3c, identifier: WB37074
2026-03-30 05:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-30 05:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074
2026-03-30 05:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3baa359f-fda7-52c2-be4b-625772968c3c with identifier: WB37074 to the API
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:54Z',
 'fuel_type': 'petrol',
 'id': '3baa359f-fda7-52c2-be4b-625772968c3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB37074',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 55931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': '4Motion BlueMotion',
 'year': 2020}
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Saving data for WB37074: {'auction_closing_time': 1774884834.0, 'created_time': 1774552726.965204, 'last_price_update_time': 1774849248.000696}
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB37074') HTTP/1.1" 204 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for DB26331: 2
2026-03-30 05:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with identifier: DB26331
2026-03-30 05:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with scrape type 2
2026-03-30 05:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with scrape type 2
2026-03-30 05:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46b610b-1db5-5abf-86ca-f7a63ddb4c4f, identifier: DB26331
2026-03-30 05:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with identifier: DB26331
2026-03-30 05:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with identifier: DB26331
2026-03-30 05:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46b610b-1db5-5abf-86ca-f7a63ddb4c4f with identifier: DB26331 to the API
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:32:08Z',
 'fuel_type': 'petrol',
 'id': 'a46b610b-1db5-5abf-86ca-f7a63ddb4c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB26331',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 117707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-23',
 'seller_name': None,
 'title': 'Opel Corsa 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Saving data for DB26331: {'auction_closing_time': 1774884728.0, 'created_time': 1774637252.178288, 'last_price_update_time': 1774849248.506504}
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB26331') HTTP/1.1" 204 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for TK27520: 0
2026-03-30 05:40:48 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Scrape type for VW20064: 2
2026-03-30 05:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5787306-bc93-5f77-b4be-3458160a097c with identifier: VW20064
2026-03-30 05:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5787306-bc93-5f77-b4be-3458160a097c with scrape type 2
2026-03-30 05:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5787306-bc93-5f77-b4be-3458160a097c with scrape type 2
2026-03-30 05:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5787306-bc93-5f77-b4be-3458160a097c, identifier: VW20064
2026-03-30 05:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5787306-bc93-5f77-b4be-3458160a097c with identifier: VW20064
2026-03-30 05:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5787306-bc93-5f77-b4be-3458160a097c with identifier: VW20064
2026-03-30 05:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5787306-bc93-5f77-b4be-3458160a097c with identifier: VW20064 to the API
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'hybrid',
 'id': 'f5787306-bc93-5f77-b4be-3458160a097c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW20064',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 144366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 Hybrid T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-30 05:40:48 [auto1.de] INFO: Saving data for VW20064: {'auction_closing_time': 1774885641.0, 'created_time': 1774349762.007078, 'last_price_update_time': 1774849248.956673}
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW20064') HTTP/1.1" 204 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for KF40481: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for EG14085: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for GH53408: 2
2026-03-30 05:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14309de5-3bb4-523b-9c6c-638cb3c84f9f with identifier: GH53408
2026-03-30 05:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14309de5-3bb4-523b-9c6c-638cb3c84f9f with scrape type 2
2026-03-30 05:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14309de5-3bb4-523b-9c6c-638cb3c84f9f with scrape type 2
2026-03-30 05:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14309de5-3bb4-523b-9c6c-638cb3c84f9f, identifier: GH53408
2026-03-30 05:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14309de5-3bb4-523b-9c6c-638cb3c84f9f with identifier: GH53408
2026-03-30 05:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14309de5-3bb4-523b-9c6c-638cb3c84f9f with identifier: GH53408
2026-03-30 05:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14309de5-3bb4-523b-9c6c-638cb3c84f9f with identifier: GH53408 to the API
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:03:00Z',
 'fuel_type': 'petrol',
 'id': '14309de5-3bb4-523b-9c6c-638cb3c84f9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH53408',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 22659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-06',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Saving data for GH53408: {'auction_closing_time': 1774882980.0, 'created_time': 1774638623.388018, 'last_price_update_time': 1774849249.540808}
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH53408') HTTP/1.1" 204 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for XP52765: 0
2026-03-30 05:40:49 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-30 05:40:49 [auto1.de] INFO: Scrape type for UM78498: 2
2026-03-30 05:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-30 05:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bbf222-297a-5e1d-937a-be462ff27e02 with scrape type 2
2026-03-30 05:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bbf222-297a-5e1d-937a-be462ff27e02 with scrape type 2
2026-03-30 05:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60bbf222-297a-5e1d-937a-be462ff27e02, identifier: UM78498
2026-03-30 05:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-30 05:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498
2026-03-30 05:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60bbf222-297a-5e1d-937a-be462ff27e02 with identifier: UM78498 to the API
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'diesel',
 'id': '60bbf222-297a-5e1d-937a-be462ff27e02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM78498',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 166972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-19',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI M Tourer L2',
 'transmission': 'automatic',
 'trim': 'M Tourer L2',
 'year': 2021}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Saving data for UM78498: {'auction_closing_time': 1774883380.0, 'created_time': 1774552896.802398, 'last_price_update_time': 1774849250.058166}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM78498') HTTP/1.1" 204 0
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Scrape type for WM97258: 0
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Scrape type for NJ08644: 2
2026-03-30 05:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad984ea0-f88a-523c-9e37-888e1d6f6546 with identifier: NJ08644
2026-03-30 05:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad984ea0-f88a-523c-9e37-888e1d6f6546 with scrape type 2
2026-03-30 05:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad984ea0-f88a-523c-9e37-888e1d6f6546 with scrape type 2
2026-03-30 05:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad984ea0-f88a-523c-9e37-888e1d6f6546, identifier: NJ08644
2026-03-30 05:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad984ea0-f88a-523c-9e37-888e1d6f6546 with identifier: NJ08644
2026-03-30 05:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad984ea0-f88a-523c-9e37-888e1d6f6546 with identifier: NJ08644
2026-03-30 05:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad984ea0-f88a-523c-9e37-888e1d6f6546 with identifier: NJ08644 to the API
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'ad984ea0-f88a-523c-9e37-888e1d6f6546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ08644',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 43328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-01',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Saving data for NJ08644: {'auction_closing_time': 1774884436.0, 'created_time': 1774638757.999473, 'last_price_update_time': 1774849250.45218}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ08644') HTTP/1.1" 204 0
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Scrape type for CM40362: 2
2026-03-30 05:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11ce81b-ac62-57b0-a02b-fd927772cf11 with identifier: CM40362
2026-03-30 05:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11ce81b-ac62-57b0-a02b-fd927772cf11 with scrape type 2
2026-03-30 05:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11ce81b-ac62-57b0-a02b-fd927772cf11 with scrape type 2
2026-03-30 05:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a11ce81b-ac62-57b0-a02b-fd927772cf11, identifier: CM40362
2026-03-30 05:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a11ce81b-ac62-57b0-a02b-fd927772cf11 with identifier: CM40362
2026-03-30 05:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a11ce81b-ac62-57b0-a02b-fd927772cf11 with identifier: CM40362
2026-03-30 05:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a11ce81b-ac62-57b0-a02b-fd927772cf11 with identifier: CM40362 to the API
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:31:17Z',
 'fuel_type': 'petrol',
 'id': 'a11ce81b-ac62-57b0-a02b-fd927772cf11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM40362',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Saving data for CM40362: {'auction_closing_time': 1774884677.0, 'created_time': 1774637268.183582, 'last_price_update_time': 1774849250.831926}
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM40362') HTTP/1.1" 204 0
2026-03-30 05:40:50 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-30 05:40:50 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-30 05:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:51 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:51 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-30 05:40:51 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-30 05:40:51 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-30 05:40:51 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-30 05:40:51 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-30 05:40:51 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-30 05:40:51 [auto1.de] INFO: Scrape type for XG36075: 2
2026-03-30 05:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with identifier: XG36075
2026-03-30 05:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with scrape type 2
2026-03-30 05:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with scrape type 2
2026-03-30 05:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3aa028bf-1168-5a0f-b470-da1d1b6df5b6, identifier: XG36075
2026-03-30 05:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with identifier: XG36075
2026-03-30 05:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with identifier: XG36075
2026-03-30 05:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3aa028bf-1168-5a0f-b470-da1d1b6df5b6 with identifier: XG36075 to the API
2026-03-30 05:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'diesel',
 'id': '3aa028bf-1168-5a0f-b470-da1d1b6df5b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG36075',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 126757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Inscription',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2018}
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Saving data for XG36075: {'auction_closing_time': 1774883505.0, 'created_time': 1774637239.082616, 'last_price_update_time': 1774849252.137492}
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG36075') HTTP/1.1" 204 0
2026-03-30 05:40:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for DK81412: 2
2026-03-30 05:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-30 05:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e7e32a-4db7-54c5-b687-c19ee8026629 with scrape type 2
2026-03-30 05:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e7e32a-4db7-54c5-b687-c19ee8026629 with scrape type 2
2026-03-30 05:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12e7e32a-4db7-54c5-b687-c19ee8026629, identifier: DK81412
2026-03-30 05:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-30 05:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412
2026-03-30 05:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12e7e32a-4db7-54c5-b687-c19ee8026629 with identifier: DK81412 to the API
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'petrol',
 'id': '12e7e32a-4db7-54c5-b687-c19ee8026629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK81412',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 110174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Saving data for DK81412: {'auction_closing_time': 1774884997.0, 'created_time': 1774551734.52958, 'last_price_update_time': 1774849252.676203}
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK81412') HTTP/1.1" 204 0
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for SK08799: 0
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-30 05:40:52 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-30 05:40:52 [auto1.de] INFO: Scrape type for MK32752: 2
2026-03-30 05:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e129d15f-945b-5ecf-9206-41f82fdd8b31 with identifier: MK32752
2026-03-30 05:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e129d15f-945b-5ecf-9206-41f82fdd8b31 with scrape type 2
2026-03-30 05:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e129d15f-945b-5ecf-9206-41f82fdd8b31 with scrape type 2
2026-03-30 05:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e129d15f-945b-5ecf-9206-41f82fdd8b31, identifier: MK32752
2026-03-30 05:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e129d15f-945b-5ecf-9206-41f82fdd8b31 with identifier: MK32752
2026-03-30 05:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e129d15f-945b-5ecf-9206-41f82fdd8b31 with identifier: MK32752
2026-03-30 05:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e129d15f-945b-5ecf-9206-41f82fdd8b31 with identifier: MK32752 to the API
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:55:46Z',
 'fuel_type': 'petrol',
 'id': 'e129d15f-945b-5ecf-9206-41f82fdd8b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK32752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 107382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2010}
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Saving data for MK32752: {'auction_closing_time': 1774886146.0, 'created_time': 1773945809.915538, 'last_price_update_time': 1774849253.217987}
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK32752') HTTP/1.1" 204 0
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Scrape type for YS74184: 2
2026-03-30 05:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-30 05:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with scrape type 2
2026-03-30 05:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with scrape type 2
2026-03-30 05:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47299e3b-089a-57a1-a3cb-b97a85fe0b20, identifier: YS74184
2026-03-30 05:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-30 05:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184
2026-03-30 05:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47299e3b-089a-57a1-a3cb-b97a85fe0b20 with identifier: YS74184 to the API
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:25:14Z',
 'fuel_type': 'petrol',
 'id': '47299e3b-089a-57a1-a3cb-b97a85fe0b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS74184',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 115845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Innovation ecoFlex',
 'transmission': 'automatic',
 'trim': 'Innovation ecoFlex',
 'year': 2018}
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Saving data for YS74184: {'auction_closing_time': 1774884314.0, 'created_time': 1774589456.62032, 'last_price_update_time': 1774849253.599476}
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS74184') HTTP/1.1" 204 0
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Scrape type for VS20151: 0
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Scrape type for JR87294: 0
2026-03-30 05:40:53 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-30 05:40:53 [auto1.de] INFO: Scrape type for ST89847: 2
2026-03-30 05:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85392d4a-47f9-5877-a9c8-580210f62a17 with identifier: ST89847
2026-03-30 05:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85392d4a-47f9-5877-a9c8-580210f62a17 with scrape type 2
2026-03-30 05:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85392d4a-47f9-5877-a9c8-580210f62a17 with scrape type 2
2026-03-30 05:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85392d4a-47f9-5877-a9c8-580210f62a17, identifier: ST89847
2026-03-30 05:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85392d4a-47f9-5877-a9c8-580210f62a17 with identifier: ST89847
2026-03-30 05:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85392d4a-47f9-5877-a9c8-580210f62a17 with identifier: ST89847
2026-03-30 05:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85392d4a-47f9-5877-a9c8-580210f62a17 with identifier: ST89847 to the API
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:38:38Z',
 'fuel_type': 'petrol',
 'id': '85392d4a-47f9-5877-a9c8-580210f62a17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST89847',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 32066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Fiat 500C 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-30 05:40:54 [auto1.de] INFO: Saving data for ST89847: {'auction_closing_time': 1774885118.0, 'created_time': 1774637912.906034, 'last_price_update_time': 1774849254.066494}
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST89847') HTTP/1.1" 204 0
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-30 05:40:54 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-30 05:40:54 [auto1.de] INFO: Scrape type for XV15906: 0
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-30 05:40:54 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-30 05:40:54 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-30 05:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:55 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for HA44433: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for LL60682: 2
2026-03-30 05:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with identifier: LL60682
2026-03-30 05:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with scrape type 2
2026-03-30 05:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with scrape type 2
2026-03-30 05:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6cf410c-d4d5-5fa9-93dd-9915effc25f9, identifier: LL60682
2026-03-30 05:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with identifier: LL60682
2026-03-30 05:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with identifier: LL60682
2026-03-30 05:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6cf410c-d4d5-5fa9-93dd-9915effc25f9 with identifier: LL60682 to the API
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:43:04Z',
 'fuel_type': 'petrol',
 'id': 'a6cf410c-d4d5-5fa9-93dd-9915effc25f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL60682',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 50001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-17',
 'seller_name': None,
 'title': 'Cupra Formentor 2.5 TSI VZ5 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ5 4Drive',
 'year': 2023}
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Saving data for LL60682: {'auction_closing_time': 1774885384.0, 'created_time': 1774639343.638176, 'last_price_update_time': 1774849255.491829}
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL60682') HTTP/1.1" 204 0
2026-03-30 05:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for EX67189: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-30 05:40:55 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-30 05:40:55 [auto1.de] INFO: Scrape type for SC92751: 2
2026-03-30 05:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-30 05:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b48adb90-380e-592a-9fe3-d199d59260b0 with scrape type 2
2026-03-30 05:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b48adb90-380e-592a-9fe3-d199d59260b0 with scrape type 2
2026-03-30 05:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b48adb90-380e-592a-9fe3-d199d59260b0, identifier: SC92751
2026-03-30 05:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-30 05:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751
2026-03-30 05:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b48adb90-380e-592a-9fe3-d199d59260b0 with identifier: SC92751 to the API
2026-03-30 05:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:29Z',
 'fuel_type': 'diesel',
 'id': 'b48adb90-380e-592a-9fe3-d199d59260b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC92751',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 270152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-30 05:40:56 [auto1.de] INFO: Saving data for SC92751: {'auction_closing_time': 1774883849.0, 'created_time': 1774552441.047834, 'last_price_update_time': 1774849256.125631}
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC92751') HTTP/1.1" 204 0
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-30 05:40:56 [auto1.de] INFO: Scrape type for TP96640: 2
2026-03-30 05:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with identifier: TP96640
2026-03-30 05:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with scrape type 2
2026-03-30 05:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with scrape type 2
2026-03-30 05:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a787c7b-4247-5db7-9a32-ad7bd39be8ac, identifier: TP96640
2026-03-30 05:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with identifier: TP96640
2026-03-30 05:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with identifier: TP96640
2026-03-30 05:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a787c7b-4247-5db7-9a32-ad7bd39be8ac with identifier: TP96640 to the API
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:09:44Z',
 'fuel_type': 'diesel',
 'id': '4a787c7b-4247-5db7-9a32-ad7bd39be8ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP96640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 304578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2010}
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-30 05:40:56 [auto1.de] INFO: Saving data for TP96640: {'auction_closing_time': 1774883384.0, 'created_time': 1773945616.848683, 'last_price_update_time': 1774849256.60068}
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP96640') HTTP/1.1" 204 0
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-30 05:40:56 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-30 05:40:56 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-30 05:40:56 [auto1.de] INFO: Scrape type for CG07330: 2
2026-03-30 05:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with identifier: CG07330
2026-03-30 05:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with scrape type 2
2026-03-30 05:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with scrape type 2
2026-03-30 05:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4, identifier: CG07330
2026-03-30 05:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with identifier: CG07330
2026-03-30 05:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with identifier: CG07330
2026-03-30 05:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4 with identifier: CG07330 to the API
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'petrol',
 'id': 'ffd9556c-3ee6-5cb4-bfc7-6b832b95f1b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG07330',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 7520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.0 SCe Essential',
 'transmission': 'manual',
 'trim': 'Essential',
 'year': 2020}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Saving data for CG07330: {'auction_closing_time': 1774885735.0, 'created_time': 1773830219.531706, 'last_price_update_time': 1774849257.061402}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG07330') HTTP/1.1" 204 0
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Scrape type for US86443: 2
2026-03-30 05:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3c145c1-5752-528e-9a0c-0c0d4a50de20 with identifier: US86443
2026-03-30 05:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3c145c1-5752-528e-9a0c-0c0d4a50de20 with scrape type 2
2026-03-30 05:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3c145c1-5752-528e-9a0c-0c0d4a50de20 with scrape type 2
2026-03-30 05:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3c145c1-5752-528e-9a0c-0c0d4a50de20, identifier: US86443
2026-03-30 05:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3c145c1-5752-528e-9a0c-0c0d4a50de20 with identifier: US86443
2026-03-30 05:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3c145c1-5752-528e-9a0c-0c0d4a50de20 with identifier: US86443
2026-03-30 05:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3c145c1-5752-528e-9a0c-0c0d4a50de20 with identifier: US86443 to the API
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:09:33Z',
 'fuel_type': 'petrol',
 'id': 'b3c145c1-5752-528e-9a0c-0c0d4a50de20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US86443',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 108247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2017}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Saving data for US86443: {'auction_closing_time': 1774883373.0, 'created_time': 1774637814.890684, 'last_price_update_time': 1774849257.492048}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US86443') HTTP/1.1" 204 0
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Scrape type for XR15758: 2
2026-03-30 05:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-30 05:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eaafb08-a723-543d-b0e3-83469eee03f8 with scrape type 2
2026-03-30 05:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eaafb08-a723-543d-b0e3-83469eee03f8 with scrape type 2
2026-03-30 05:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eaafb08-a723-543d-b0e3-83469eee03f8, identifier: XR15758
2026-03-30 05:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-30 05:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758
2026-03-30 05:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eaafb08-a723-543d-b0e3-83469eee03f8 with identifier: XR15758 to the API
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:37Z',
 'fuel_type': 'diesel',
 'id': '6eaafb08-a723-543d-b0e3-83469eee03f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR15758',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 226430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-24',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Saving data for XR15758: {'auction_closing_time': 1774884817.0, 'created_time': 1774552725.593311, 'last_price_update_time': 1774849257.896871}
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR15758') HTTP/1.1" 204 0
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-30 05:40:57 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-30 05:40:57 [auto1.de] INFO: Scrape type for HV40211: 2
2026-03-30 05:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-30 05:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc20229b-741a-5c76-8de2-ea7c6714fac5 with scrape type 2
2026-03-30 05:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc20229b-741a-5c76-8de2-ea7c6714fac5 with scrape type 2
2026-03-30 05:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc20229b-741a-5c76-8de2-ea7c6714fac5, identifier: HV40211
2026-03-30 05:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-30 05:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211
2026-03-30 05:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc20229b-741a-5c76-8de2-ea7c6714fac5 with identifier: HV40211 to the API
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:46:06Z',
 'fuel_type': 'petrol',
 'id': 'bc20229b-741a-5c76-8de2-ea7c6714fac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV40211',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 140783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-30 05:40:58 [auto1.de] INFO: Saving data for HV40211: {'auction_closing_time': 1774885566.0, 'created_time': 1774552693.132467, 'last_price_update_time': 1774849258.316388}
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV40211') HTTP/1.1" 204 0
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-30 05:40:58 [auto1.de] INFO: Scrape type for ZG52180: 2
2026-03-30 05:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-30 05:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49da4110-a21d-500f-8b3b-bb4f3514bd5d with scrape type 2
2026-03-30 05:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49da4110-a21d-500f-8b3b-bb4f3514bd5d with scrape type 2
2026-03-30 05:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49da4110-a21d-500f-8b3b-bb4f3514bd5d, identifier: ZG52180
2026-03-30 05:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-30 05:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180
2026-03-30 05:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49da4110-a21d-500f-8b3b-bb4f3514bd5d with identifier: ZG52180 to the API
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:30Z',
 'fuel_type': 'diesel',
 'id': '49da4110-a21d-500f-8b3b-bb4f3514bd5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG52180',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 262806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-23',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-30 05:40:58 [auto1.de] INFO: Saving data for ZG52180: {'auction_closing_time': 1774884690.0, 'created_time': 1774550427.406458, 'last_price_update_time': 1774849258.820577}
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG52180') HTTP/1.1" 204 0
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-30 05:40:58 [auto1.de] INFO: Scrape type for JY24308: 0
2026-03-30 05:40:58 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-30 05:40:58 [auto1.de] INFO: Scrape type for DV65946: 2
2026-03-30 05:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d74c072a-aa77-5af2-91f4-f4ca22b08521 with identifier: DV65946
2026-03-30 05:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d74c072a-aa77-5af2-91f4-f4ca22b08521 with scrape type 2
2026-03-30 05:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d74c072a-aa77-5af2-91f4-f4ca22b08521 with scrape type 2
2026-03-30 05:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d74c072a-aa77-5af2-91f4-f4ca22b08521, identifier: DV65946
2026-03-30 05:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d74c072a-aa77-5af2-91f4-f4ca22b08521 with identifier: DV65946
2026-03-30 05:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d74c072a-aa77-5af2-91f4-f4ca22b08521 with identifier: DV65946
2026-03-30 05:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d74c072a-aa77-5af2-91f4-f4ca22b08521 with identifier: DV65946 to the API
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:28:43Z',
 'fuel_type': 'petrol',
 'id': 'd74c072a-aa77-5af2-91f4-f4ca22b08521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV65946',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 64897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-28',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2014}
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-30 05:40:59 [auto1.de] INFO: Saving data for DV65946: {'auction_closing_time': 1774884523.0, 'created_time': 1774639514.477706, 'last_price_update_time': 1774849259.243142}
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV65946') HTTP/1.1" 204 0
2026-03-30 05:40:59 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-30 05:40:59 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-30 05:40:59 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6742 | hits on page: 40
2026-03-30 05:40:59 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-30 05:40:59 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-30 05:40:59 [auto1.de] INFO: Scrape type for VJ26450: 2
2026-03-30 05:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-30 05:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with scrape type 2
2026-03-30 05:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with scrape type 2
2026-03-30 05:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4, identifier: VJ26450
2026-03-30 05:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-30 05:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450
2026-03-30 05:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4 with identifier: VJ26450 to the API
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:58Z',
 'fuel_type': 'diesel',
 'id': '044b87ce-5c45-5e49-a6ed-cc9e33fa6ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ26450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 216618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-30 05:40:59 [auto1.de] INFO: Saving data for VJ26450: {'auction_closing_time': 1774886338.0, 'created_time': 1774550441.134085, 'last_price_update_time': 1774849259.687583}
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ26450') HTTP/1.1" 204 0
2026-03-30 05:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:40:59 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-30 05:40:59 [auto1.de] INFO: Scrape type for WC38783: 2
2026-03-30 05:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-30 05:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with scrape type 2
2026-03-30 05:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with scrape type 2
2026-03-30 05:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968, identifier: WC38783
2026-03-30 05:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-30 05:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783
2026-03-30 05:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968 with identifier: WC38783 to the API
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': 'f6343b2f-f6b5-57cd-9ba1-7f7fc5a09968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC38783',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 422135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Saving data for WC38783: {'auction_closing_time': 1774885702.0, 'created_time': 1773945977.857225, 'last_price_update_time': 1774849260.106861}
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC38783') HTTP/1.1" 204 0
2026-03-30 05:41:00 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Scrape type for UD91634: 2
2026-03-30 05:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-30 05:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73f496cb-609d-5a07-b991-c45b37b0b1b9 with scrape type 2
2026-03-30 05:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73f496cb-609d-5a07-b991-c45b37b0b1b9 with scrape type 2
2026-03-30 05:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73f496cb-609d-5a07-b991-c45b37b0b1b9, identifier: UD91634
2026-03-30 05:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-30 05:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634
2026-03-30 05:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73f496cb-609d-5a07-b991-c45b37b0b1b9 with identifier: UD91634 to the API
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'hybrid',
 'id': '73f496cb-609d-5a07-b991-c45b37b0b1b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD91634',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 53713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Saving data for UD91634: {'auction_closing_time': 1774885292.0, 'created_time': 1774552123.504869, 'last_price_update_time': 1774849260.486804}
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD91634') HTTP/1.1" 204 0
2026-03-30 05:41:00 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Scrape type for UL11229: 0
2026-03-30 05:41:00 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-30 05:41:00 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-30 05:41:00 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-30 05:41:00 [auto1.de] INFO: Scrape type for HF93741: 2
2026-03-30 05:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-30 05:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with scrape type 2
2026-03-30 05:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with scrape type 2
2026-03-30 05:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4, identifier: HF93741
2026-03-30 05:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-30 05:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741
2026-03-30 05:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 904ccd4f-3265-5b18-9f7c-2f3a57a57eb4 with identifier: HF93741 to the API
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'petrol',
 'id': '904ccd4f-3265-5b18-9f7c-2f3a57a57eb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF93741',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 87837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2018}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Saving data for HF93741: {'auction_closing_time': 1774885474.0, 'created_time': 1774552978.978507, 'last_price_update_time': 1774849261.03953}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF93741') HTTP/1.1" 204 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for NA89904: 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for VN00313: 2
2026-03-30 05:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb061125-a17c-5cb5-9b46-31fcf3975a4d with identifier: VN00313
2026-03-30 05:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb061125-a17c-5cb5-9b46-31fcf3975a4d with scrape type 2
2026-03-30 05:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb061125-a17c-5cb5-9b46-31fcf3975a4d with scrape type 2
2026-03-30 05:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb061125-a17c-5cb5-9b46-31fcf3975a4d, identifier: VN00313
2026-03-30 05:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb061125-a17c-5cb5-9b46-31fcf3975a4d with identifier: VN00313
2026-03-30 05:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb061125-a17c-5cb5-9b46-31fcf3975a4d with identifier: VN00313
2026-03-30 05:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb061125-a17c-5cb5-9b46-31fcf3975a4d with identifier: VN00313 to the API
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:27Z',
 'fuel_type': 'diesel',
 'id': 'cb061125-a17c-5cb5-9b46-31fcf3975a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN00313',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 102012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-01',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Premium Edition 4x4',
 'transmission': 'automatic',
 'trim': 'Premium Edition 4x4',
 'year': 2018}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Saving data for VN00313: {'auction_closing_time': 1774884927.0, 'created_time': 1774034631.649083, 'last_price_update_time': 1774849261.505138}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN00313') HTTP/1.1" 204 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for GV24790: 0
2026-03-30 05:41:01 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Scrape type for AG68555: 2
2026-03-30 05:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-30 05:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba71c422-5647-58af-b31c-b8ed3c8681c6 with scrape type 2
2026-03-30 05:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba71c422-5647-58af-b31c-b8ed3c8681c6 with scrape type 2
2026-03-30 05:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba71c422-5647-58af-b31c-b8ed3c8681c6, identifier: AG68555
2026-03-30 05:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-30 05:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555
2026-03-30 05:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba71c422-5647-58af-b31c-b8ed3c8681c6 with identifier: AG68555 to the API
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:33:22Z',
 'fuel_type': 'hybrid',
 'id': 'ba71c422-5647-58af-b31c-b8ed3c8681c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG68555',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 23282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-30 05:41:01 [auto1.de] INFO: Saving data for AG68555: {'auction_closing_time': 1774884802.0, 'created_time': 1774349830.615802, 'last_price_update_time': 1774849261.947306}
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68555') HTTP/1.1" 204 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for DJ97721: 2
2026-03-30 05:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-30 05:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ddd199f-e1f1-5019-8697-6b41934d93eb with scrape type 2
2026-03-30 05:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ddd199f-e1f1-5019-8697-6b41934d93eb with scrape type 2
2026-03-30 05:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ddd199f-e1f1-5019-8697-6b41934d93eb, identifier: DJ97721
2026-03-30 05:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-30 05:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721
2026-03-30 05:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ddd199f-e1f1-5019-8697-6b41934d93eb with identifier: DJ97721 to the API
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:21:57Z',
 'fuel_type': 'petrol',
 'id': '5ddd199f-e1f1-5019-8697-6b41934d93eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ97721',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3',
 'odometer': 116591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-02',
 'seller_name': None,
 'title': 'Audi RS Q3 2.5 TFSI quattro Performance',
 'transmission': 'automatic',
 'trim': 'quattro Performance',
 'year': 2017}
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Saving data for DJ97721: {'auction_closing_time': 1774884117.0, 'created_time': 1774552524.747768, 'last_price_update_time': 1774849262.532876}
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ97721') HTTP/1.1" 204 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-30 05:41:02 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-30 05:41:02 [auto1.de] INFO: Scrape type for ZE72511: 2
2026-03-30 05:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbbfcd17-4b1c-5532-94eb-f377ba253c9c with identifier: ZE72511
2026-03-30 05:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbbfcd17-4b1c-5532-94eb-f377ba253c9c with scrape type 2
2026-03-30 05:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbbfcd17-4b1c-5532-94eb-f377ba253c9c with scrape type 2
2026-03-30 05:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbbfcd17-4b1c-5532-94eb-f377ba253c9c, identifier: ZE72511
2026-03-30 05:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbbfcd17-4b1c-5532-94eb-f377ba253c9c with identifier: ZE72511
2026-03-30 05:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbbfcd17-4b1c-5532-94eb-f377ba253c9c with identifier: ZE72511
2026-03-30 05:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbbfcd17-4b1c-5532-94eb-f377ba253c9c with identifier: ZE72511 to the API
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:25Z',
 'fuel_type': 'petrol',
 'id': 'cbbfcd17-4b1c-5532-94eb-f377ba253c9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE72511',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 84635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Saving data for ZE72511: {'auction_closing_time': 1774882825.0, 'created_time': 1774550346.777351, 'last_price_update_time': 1774849263.055432}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE72511') HTTP/1.1" 204 0
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Scrape type for XD68871: 0
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Scrape type for FH31570: 2
2026-03-30 05:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-30 05:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with scrape type 2
2026-03-30 05:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with scrape type 2
2026-03-30 05:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2664929a-bc55-5ca7-965d-c8a6e3b549a4, identifier: FH31570
2026-03-30 05:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-30 05:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570
2026-03-30 05:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2664929a-bc55-5ca7-965d-c8a6e3b549a4 with identifier: FH31570 to the API
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:10:22Z',
 'fuel_type': 'petrol',
 'id': '2664929a-bc55-5ca7-965d-c8a6e3b549a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH31570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 107696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Allstar',
 'transmission': 'manual',
 'trim': 'Allstar',
 'year': 2016}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Saving data for FH31570: {'auction_closing_time': 1774883422.0, 'created_time': 1774551191.52656, 'last_price_update_time': 1774849263.488113}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH31570') HTTP/1.1" 204 0
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-30 05:41:03 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Scrape type for MP71410: 2
2026-03-30 05:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fedfc79-15a2-5a0a-98b8-606a85612bbb with identifier: MP71410
2026-03-30 05:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fedfc79-15a2-5a0a-98b8-606a85612bbb with scrape type 2
2026-03-30 05:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fedfc79-15a2-5a0a-98b8-606a85612bbb with scrape type 2
2026-03-30 05:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fedfc79-15a2-5a0a-98b8-606a85612bbb, identifier: MP71410
2026-03-30 05:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fedfc79-15a2-5a0a-98b8-606a85612bbb with identifier: MP71410
2026-03-30 05:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fedfc79-15a2-5a0a-98b8-606a85612bbb with identifier: MP71410
2026-03-30 05:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fedfc79-15a2-5a0a-98b8-606a85612bbb with identifier: MP71410 to the API
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:03Z',
 'fuel_type': 'petrol',
 'id': '7fedfc79-15a2-5a0a-98b8-606a85612bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP71410',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 160517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-14',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2016}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-30 05:41:03 [auto1.de] INFO: Saving data for MP71410: {'auction_closing_time': 1774883703.0, 'created_time': 1773135950.200157, 'last_price_update_time': 1774849263.894565}
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP71410') HTTP/1.1" 204 0
2026-03-30 05:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:04 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-30 05:41:04 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-30 05:41:04 [auto1.de] INFO: Scrape type for DD20559: 2
2026-03-30 05:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d2efedc-87f9-5e8b-b75e-a51573c15518 with identifier: DD20559
2026-03-30 05:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d2efedc-87f9-5e8b-b75e-a51573c15518 with scrape type 2
2026-03-30 05:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d2efedc-87f9-5e8b-b75e-a51573c15518 with scrape type 2
2026-03-30 05:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d2efedc-87f9-5e8b-b75e-a51573c15518, identifier: DD20559
2026-03-30 05:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d2efedc-87f9-5e8b-b75e-a51573c15518 with identifier: DD20559
2026-03-30 05:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d2efedc-87f9-5e8b-b75e-a51573c15518 with identifier: DD20559
2026-03-30 05:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d2efedc-87f9-5e8b-b75e-a51573c15518 with identifier: DD20559 to the API
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:25:36Z',
 'fuel_type': 'petrol',
 'id': '4d2efedc-87f9-5e8b-b75e-a51573c15518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD20559',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 145764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-30 05:41:04 [auto1.de] INFO: Saving data for DD20559: {'auction_closing_time': 1774884336.0, 'created_time': 1773226384.107312, 'last_price_update_time': 1774849264.544374}
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD20559') HTTP/1.1" 204 0
2026-03-30 05:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-30 05:41:04 [auto1.de] INFO: Scrape type for VB56822: 0
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-30 05:41:04 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-30 05:41:04 [auto1.de] INFO: Scrape type for EB81332: 2
2026-03-30 05:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-30 05:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 873ecf28-8bd2-57e6-a9cf-67607f60a489 with scrape type 2
2026-03-30 05:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 873ecf28-8bd2-57e6-a9cf-67607f60a489 with scrape type 2
2026-03-30 05:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 873ecf28-8bd2-57e6-a9cf-67607f60a489, identifier: EB81332
2026-03-30 05:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-30 05:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332
2026-03-30 05:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 873ecf28-8bd2-57e6-a9cf-67607f60a489 with identifier: EB81332 to the API
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:33:50Z',
 'fuel_type': 'petrol',
 'id': '873ecf28-8bd2-57e6-a9cf-67607f60a489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB81332',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 126108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2017}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Saving data for EB81332: {'auction_closing_time': 1774884830.0, 'created_time': 1774551111.038421, 'last_price_update_time': 1774849265.017968}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB81332') HTTP/1.1" 204 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Scrape type for HM11779: 2
2026-03-30 05:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-30 05:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with scrape type 2
2026-03-30 05:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with scrape type 2
2026-03-30 05:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd, identifier: HM11779
2026-03-30 05:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-30 05:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779
2026-03-30 05:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a484ee1-2344-5f8a-9c1e-2c97b64033bd with identifier: HM11779 to the API
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'diesel',
 'id': '6a484ee1-2344-5f8a-9c1e-2c97b64033bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM11779',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 310796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-05',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Saving data for HM11779: {'auction_closing_time': 1774882837.0, 'created_time': 1774552690.84911, 'last_price_update_time': 1774849265.513212}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM11779') HTTP/1.1" 204 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Scrape type for NZ68458: 2
2026-03-30 05:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-30 05:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17f86ac1-ef20-5b61-821b-7f331a3f1868 with scrape type 2
2026-03-30 05:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17f86ac1-ef20-5b61-821b-7f331a3f1868 with scrape type 2
2026-03-30 05:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17f86ac1-ef20-5b61-821b-7f331a3f1868, identifier: NZ68458
2026-03-30 05:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-30 05:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458
2026-03-30 05:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17f86ac1-ef20-5b61-821b-7f331a3f1868 with identifier: NZ68458 to the API
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:54:56Z',
 'fuel_type': 'diesel',
 'id': '17f86ac1-ef20-5b61-821b-7f331a3f1868',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ68458',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 219287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-10',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Saving data for NZ68458: {'auction_closing_time': 1774886096.0, 'created_time': 1774550443.938862, 'last_price_update_time': 1774849265.947935}
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ68458') HTTP/1.1" 204 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-30 05:41:05 [auto1.de] INFO: Scrape type for CU11315: 0
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-30 05:41:05 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-30 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Scrape type for KW68536: 2
2026-03-30 05:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec6adfff-d998-5110-be4d-93a5472a65ef with identifier: KW68536
2026-03-30 05:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec6adfff-d998-5110-be4d-93a5472a65ef with scrape type 2
2026-03-30 05:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec6adfff-d998-5110-be4d-93a5472a65ef with scrape type 2
2026-03-30 05:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec6adfff-d998-5110-be4d-93a5472a65ef, identifier: KW68536
2026-03-30 05:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec6adfff-d998-5110-be4d-93a5472a65ef with identifier: KW68536
2026-03-30 05:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec6adfff-d998-5110-be4d-93a5472a65ef with identifier: KW68536
2026-03-30 05:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec6adfff-d998-5110-be4d-93a5472a65ef with identifier: KW68536 to the API
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:49:20Z',
 'fuel_type': 'diesel',
 'id': 'ec6adfff-d998-5110-be4d-93a5472a65ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW68536',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 188153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-05',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Saving data for KW68536: {'auction_closing_time': 1774885760.0, 'created_time': 1774639469.517619, 'last_price_update_time': 1774849266.391436}
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW68536') HTTP/1.1" 204 0
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Scrape type for FX32627: 2
2026-03-30 05:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-30 05:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with scrape type 2
2026-03-30 05:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with scrape type 2
2026-03-30 05:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a, identifier: FX32627
2026-03-30 05:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-30 05:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627
2026-03-30 05:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a with identifier: FX32627 to the API
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': '9b1f35f4-a86d-5d8a-8528-fea71d0ceb7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX32627',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 92585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-22',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Saving data for FX32627: {'auction_closing_time': 1774885633.0, 'created_time': 1774550660.05661, 'last_price_update_time': 1774849266.912449}
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX32627') HTTP/1.1" 204 0
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-30 05:41:06 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-30 05:41:06 [auto1.de] INFO: Scrape type for ER89217: 2
2026-03-30 05:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71c8c380-f48d-5923-a83b-3018153f976f with identifier: ER89217
2026-03-30 05:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71c8c380-f48d-5923-a83b-3018153f976f with scrape type 2
2026-03-30 05:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71c8c380-f48d-5923-a83b-3018153f976f with scrape type 2
2026-03-30 05:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71c8c380-f48d-5923-a83b-3018153f976f, identifier: ER89217
2026-03-30 05:41:07 [scrapy.extensions.logstats] INFO: Crawled 136 pages (at 12 pages/min), scraped 956 items (at 119 items/min)
2026-03-30 05:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 05:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71c8c380-f48d-5923-a83b-3018153f976f with identifier: ER89217
2026-03-30 05:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71c8c380-f48d-5923-a83b-3018153f976f with identifier: ER89217
2026-03-30 05:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71c8c380-f48d-5923-a83b-3018153f976f with identifier: ER89217 to the API
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:01:45Z',
 'fuel_type': 'diesel',
 'id': '71c8c380-f48d-5923-a83b-3018153f976f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER89217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 169182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-06',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Multivan',
 'transmission': 'automatic',
 'trim': 'Multivan',
 'year': 2012}
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-30 05:41:07 [auto1.de] INFO: Saving data for ER89217: {'auction_closing_time': 1774882905.0, 'created_time': 1774002858.756631, 'last_price_update_time': 1774849267.305356}
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER89217') HTTP/1.1" 204 0
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-30 05:41:07 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-30 05:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:07 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-30 05:41:07 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-30 05:41:07 [auto1.de] INFO: Scrape type for KV56224: 2
2026-03-30 05:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 232ade0b-6636-5edb-9912-4fd71cb530b5 with identifier: KV56224
2026-03-30 05:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 232ade0b-6636-5edb-9912-4fd71cb530b5 with scrape type 2
2026-03-30 05:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 232ade0b-6636-5edb-9912-4fd71cb530b5 with scrape type 2
2026-03-30 05:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 232ade0b-6636-5edb-9912-4fd71cb530b5, identifier: KV56224
2026-03-30 05:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 232ade0b-6636-5edb-9912-4fd71cb530b5 with identifier: KV56224
2026-03-30 05:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 232ade0b-6636-5edb-9912-4fd71cb530b5 with identifier: KV56224
2026-03-30 05:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 232ade0b-6636-5edb-9912-4fd71cb530b5 with identifier: KV56224 to the API
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:30Z',
 'fuel_type': 'petrol',
 'id': '232ade0b-6636-5edb-9912-4fd71cb530b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV56224',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 140573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-16',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-30 05:41:07 [auto1.de] INFO: Saving data for KV56224: {'auction_closing_time': 1774885770.0, 'created_time': 1774638300.110714, 'last_price_update_time': 1774849267.871057}
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV56224') HTTP/1.1" 204 0
2026-03-30 05:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:07 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-30 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for YM11561: 2
2026-03-30 05:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-30 05:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 2
2026-03-30 05:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38dc16c-f002-590a-9f8a-847082f8cc7a with scrape type 2
2026-03-30 05:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38dc16c-f002-590a-9f8a-847082f8cc7a, identifier: YM11561
2026-03-30 05:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-30 05:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561
2026-03-30 05:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38dc16c-f002-590a-9f8a-847082f8cc7a with identifier: YM11561 to the API
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'diesel',
 'id': 'f38dc16c-f002-590a-9f8a-847082f8cc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM11561',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 97688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Saving data for YM11561: {'auction_closing_time': 1774883995.0, 'created_time': 1774553011.95982, 'last_price_update_time': 1774849268.386712}
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM11561') HTTP/1.1" 204 0
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for GS86907: 2
2026-03-30 05:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with identifier: GS86907
2026-03-30 05:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with scrape type 2
2026-03-30 05:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with scrape type 2
2026-03-30 05:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f7084ea-b197-52bc-ab8f-5e4d9128cfea, identifier: GS86907
2026-03-30 05:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with identifier: GS86907
2026-03-30 05:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with identifier: GS86907
2026-03-30 05:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f7084ea-b197-52bc-ab8f-5e4d9128cfea with identifier: GS86907 to the API
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:59:44Z',
 'fuel_type': 'petrol',
 'id': '0f7084ea-b197-52bc-ab8f-5e4d9128cfea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS86907',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 229751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Saving data for GS86907: {'auction_closing_time': 1774886384.0, 'created_time': 1773469071.091795, 'last_price_update_time': 1774849268.859974}
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS86907') HTTP/1.1" 204 0
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 05:41:08 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-30 05:41:08 [auto1.de] INFO: Scrape type for LK83365: 2
2026-03-30 05:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with identifier: LK83365
2026-03-30 05:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with scrape type 2
2026-03-30 05:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with scrape type 2
2026-03-30 05:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f88b1db9-ac9c-5a58-a2fe-7dee489159e8, identifier: LK83365
2026-03-30 05:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with identifier: LK83365
2026-03-30 05:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with identifier: LK83365
2026-03-30 05:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f88b1db9-ac9c-5a58-a2fe-7dee489159e8 with identifier: LK83365 to the API
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': 'f88b1db9-ac9c-5a58-a2fe-7dee489159e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK83365',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 197079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-18',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-30 05:41:09 [auto1.de] INFO: Saving data for LK83365: {'auction_closing_time': 1774886163.0, 'created_time': 1774639151.152096, 'last_price_update_time': 1774849269.344523}
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK83365') HTTP/1.1" 204 0
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-30 05:41:09 [auto1.de] INFO: Scrape type for YS84502: 0
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-30 05:41:09 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-30 05:41:09 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 05:41:09 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-30 05:41:09 [auto1.de] INFO: Scrape type for CZ44674: 0
2026-03-30 05:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:10 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-30 05:41:10 [auto1.de] INFO: Scrape type for HP53076: 2
2026-03-30 05:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-30 05:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03c4bca-091b-5a07-bfb2-8215642a9d72 with scrape type 2
2026-03-30 05:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03c4bca-091b-5a07-bfb2-8215642a9d72 with scrape type 2
2026-03-30 05:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03c4bca-091b-5a07-bfb2-8215642a9d72, identifier: HP53076
2026-03-30 05:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-30 05:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076
2026-03-30 05:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03c4bca-091b-5a07-bfb2-8215642a9d72 with identifier: HP53076 to the API
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:09:43Z',
 'fuel_type': 'diesel',
 'id': 'b03c4bca-091b-5a07-bfb2-8215642a9d72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP53076',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 247653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-27',
 'seller_name': None,
 'title': 'BMW 1er 120d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-30 05:41:10 [auto1.de] INFO: Saving data for HP53076: {'auction_closing_time': 1774883383.0, 'created_time': 1774552626.239979, 'last_price_update_time': 1774849270.636416}
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP53076') HTTP/1.1" 204 0
2026-03-30 05:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 05:41:10 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-30 05:41:10 [auto1.de] INFO: Scrape type for HV99123: 2
2026-03-30 05:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-30 05:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with scrape type 2
2026-03-30 05:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with scrape type 2
2026-03-30 05:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f, identifier: HV99123
2026-03-30 05:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-30 05:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123
2026-03-30 05:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f with identifier: HV99123 to the API
2026-03-30 05:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:27Z',
 'fuel_type': 'petrol',
 'id': 'e05cd5f4-9a83-5e5b-a3de-c0c2aebc964f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV99123',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 160121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'Opel Zafira 2.2 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2006}
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Saving data for HV99123: {'auction_closing_time': 1774885527.0, 'created_time': 1774589452.654502, 'last_price_update_time': 1774849271.140326}
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV99123') HTTP/1.1" 204 0
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Scrape type for NV40301: 2
2026-03-30 05:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f817356e-0acb-5152-8e97-2c9243d11d7a with identifier: NV40301
2026-03-30 05:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f817356e-0acb-5152-8e97-2c9243d11d7a with scrape type 2
2026-03-30 05:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f817356e-0acb-5152-8e97-2c9243d11d7a with scrape type 2
2026-03-30 05:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f817356e-0acb-5152-8e97-2c9243d11d7a, identifier: NV40301
2026-03-30 05:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f817356e-0acb-5152-8e97-2c9243d11d7a with identifier: NV40301
2026-03-30 05:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f817356e-0acb-5152-8e97-2c9243d11d7a with identifier: NV40301
2026-03-30 05:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f817356e-0acb-5152-8e97-2c9243d11d7a with identifier: NV40301 to the API
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:37:40Z',
 'fuel_type': 'petrol',
 'id': 'f817356e-0acb-5152-8e97-2c9243d11d7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV40301',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 112648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.0 TSI Maxi Kasten EcoProfi BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten EcoProfi BlueMotion',
 'year': 2017}
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Saving data for NV40301: {'auction_closing_time': 1774885060.0, 'created_time': 1773138379.302515, 'last_price_update_time': 1774849271.570196}
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV40301') HTTP/1.1" 204 0
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Scrape type for TN09859: 0
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-30 05:41:11 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-30 05:41:11 [auto1.de] INFO: Scrape type for AY38359: 2
2026-03-30 05:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e656d912-5bab-58a7-a5dc-098db748ded1 with identifier: AY38359
2026-03-30 05:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e656d912-5bab-58a7-a5dc-098db748ded1 with scrape type 2
2026-03-30 05:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e656d912-5bab-58a7-a5dc-098db748ded1 with scrape type 2
2026-03-30 05:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e656d912-5bab-58a7-a5dc-098db748ded1, identifier: AY38359
2026-03-30 05:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e656d912-5bab-58a7-a5dc-098db748ded1 with identifier: AY38359
2026-03-30 05:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e656d912-5bab-58a7-a5dc-098db748ded1 with identifier: AY38359
2026-03-30 05:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e656d912-5bab-58a7-a5dc-098db748ded1 with identifier: AY38359 to the API
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:35:46Z',
 'fuel_type': 'diesel',
 'id': 'e656d912-5bab-58a7-a5dc-098db748ded1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY38359',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 42862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Saving data for AY38359: {'auction_closing_time': 1774884946.0, 'created_time': 1774637650.919213, 'last_price_update_time': 1774849272.030224}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY38359') HTTP/1.1" 204 0
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Scrape type for ZF02079: 0
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Scrape type for AY73359: 2
2026-03-30 05:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c60bbf-8dbb-51da-9a5b-1241598f271e with identifier: AY73359
2026-03-30 05:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c60bbf-8dbb-51da-9a5b-1241598f271e with scrape type 2
2026-03-30 05:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c60bbf-8dbb-51da-9a5b-1241598f271e with scrape type 2
2026-03-30 05:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94c60bbf-8dbb-51da-9a5b-1241598f271e, identifier: AY73359
2026-03-30 05:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94c60bbf-8dbb-51da-9a5b-1241598f271e with identifier: AY73359
2026-03-30 05:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94c60bbf-8dbb-51da-9a5b-1241598f271e with identifier: AY73359
2026-03-30 05:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94c60bbf-8dbb-51da-9a5b-1241598f271e with identifier: AY73359 to the API
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:24:46Z',
 'fuel_type': 'petrol',
 'id': '94c60bbf-8dbb-51da-9a5b-1241598f271e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY73359',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 243861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 THP Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Saving data for AY73359: {'auction_closing_time': 1774884286.0, 'created_time': 1774637275.179063, 'last_price_update_time': 1774849272.562671}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY73359') HTTP/1.1" 204 0
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-30 05:41:12 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Scrape type for SN98432: 2
2026-03-30 05:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-30 05:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e37ed52b-2a77-59c7-bd58-602c8906cd87 with scrape type 2
2026-03-30 05:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e37ed52b-2a77-59c7-bd58-602c8906cd87 with scrape type 2
2026-03-30 05:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e37ed52b-2a77-59c7-bd58-602c8906cd87, identifier: SN98432
2026-03-30 05:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-30 05:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432
2026-03-30 05:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e37ed52b-2a77-59c7-bd58-602c8906cd87 with identifier: SN98432 to the API
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:28:15Z',
 'fuel_type': 'petrol',
 'id': 'e37ed52b-2a77-59c7-bd58-602c8906cd87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN98432',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 172539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-24',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-30 05:41:12 [auto1.de] INFO: Saving data for SN98432: {'auction_closing_time': 1774884495.0, 'created_time': 1774550989.250711, 'last_price_update_time': 1774849272.986305}
2026-03-30 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN98432') HTTP/1.1" 204 0
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Scrape type for CZ58938: 2
2026-03-30 05:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with identifier: CZ58938
2026-03-30 05:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with scrape type 2
2026-03-30 05:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with scrape type 2
2026-03-30 05:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7e1e7c0-69ac-5864-9c8d-851f9a52fab5, identifier: CZ58938
2026-03-30 05:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with identifier: CZ58938
2026-03-30 05:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with identifier: CZ58938
2026-03-30 05:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7e1e7c0-69ac-5864-9c8d-851f9a52fab5 with identifier: CZ58938 to the API
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:59:54Z',
 'fuel_type': 'petrol',
 'id': 'b7e1e7c0-69ac-5864-9c8d-851f9a52fab5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ58938',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Saving data for CZ58938: {'auction_closing_time': 1774886394.0, 'created_time': 1774639086.251172, 'last_price_update_time': 1774849273.509153}
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ58938') HTTP/1.1" 204 0
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Scrape type for FW41048: 2
2026-03-30 05:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0033100-0eca-5877-9fe0-1868052e88de with identifier: FW41048
2026-03-30 05:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0033100-0eca-5877-9fe0-1868052e88de with scrape type 2
2026-03-30 05:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0033100-0eca-5877-9fe0-1868052e88de with scrape type 2
2026-03-30 05:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0033100-0eca-5877-9fe0-1868052e88de, identifier: FW41048
2026-03-30 05:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0033100-0eca-5877-9fe0-1868052e88de with identifier: FW41048
2026-03-30 05:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0033100-0eca-5877-9fe0-1868052e88de with identifier: FW41048
2026-03-30 05:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0033100-0eca-5877-9fe0-1868052e88de with identifier: FW41048 to the API
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': 'd0033100-0eca-5877-9fe0-1868052e88de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW41048',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 34862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Saving data for FW41048: {'auction_closing_time': 1774884777.0, 'created_time': 1774639351.171849, 'last_price_update_time': 1774849273.910107}
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW41048') HTTP/1.1" 204 0
2026-03-30 05:41:13 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-30 05:41:13 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-30 05:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:14 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for MA47632: 2
2026-03-30 05:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93c89c7-4adb-5e67-8e56-fc0d716df49f with identifier: MA47632
2026-03-30 05:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93c89c7-4adb-5e67-8e56-fc0d716df49f with scrape type 2
2026-03-30 05:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f93c89c7-4adb-5e67-8e56-fc0d716df49f with scrape type 2
2026-03-30 05:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f93c89c7-4adb-5e67-8e56-fc0d716df49f, identifier: MA47632
2026-03-30 05:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f93c89c7-4adb-5e67-8e56-fc0d716df49f with identifier: MA47632
2026-03-30 05:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f93c89c7-4adb-5e67-8e56-fc0d716df49f with identifier: MA47632
2026-03-30 05:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f93c89c7-4adb-5e67-8e56-fc0d716df49f with identifier: MA47632 to the API
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:53:29Z',
 'fuel_type': 'petrol',
 'id': 'f93c89c7-4adb-5e67-8e56-fc0d716df49f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA47632',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 100644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Saving data for MA47632: {'auction_closing_time': 1774886009.0, 'created_time': 1774636851.230303, 'last_price_update_time': 1774849274.851484}
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA47632') HTTP/1.1" 204 0
2026-03-30 05:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-30 05:41:14 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-30 05:41:14 [auto1.de] INFO: Scrape type for AB05570: 2
2026-03-30 05:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-30 05:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b86b7b-686c-5c67-87e1-5d172adaac8b with scrape type 2
2026-03-30 05:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b86b7b-686c-5c67-87e1-5d172adaac8b with scrape type 2
2026-03-30 05:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b86b7b-686c-5c67-87e1-5d172adaac8b, identifier: AB05570
2026-03-30 05:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-30 05:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570
2026-03-30 05:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b86b7b-686c-5c67-87e1-5d172adaac8b with identifier: AB05570 to the API
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': '65b86b7b-686c-5c67-87e1-5d172adaac8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05570',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 138218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2011}
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-30 05:41:15 [auto1.de] INFO: Saving data for AB05570: {'auction_closing_time': 1774886090.0, 'created_time': 1774034463.486644, 'last_price_update_time': 1774849275.35113}
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB05570') HTTP/1.1" 204 0
2026-03-30 05:41:15 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-30 05:41:15 [auto1.de] INFO: Scrape type for AP13896: 2
2026-03-30 05:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-30 05:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199d7d02-91b6-522d-9977-7d559aabc6bd with scrape type 2
2026-03-30 05:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 199d7d02-91b6-522d-9977-7d559aabc6bd with scrape type 2
2026-03-30 05:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 199d7d02-91b6-522d-9977-7d559aabc6bd, identifier: AP13896
2026-03-30 05:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-30 05:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896
2026-03-30 05:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 199d7d02-91b6-522d-9977-7d559aabc6bd with identifier: AP13896 to the API
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'petrol',
 'id': '199d7d02-91b6-522d-9977-7d559aabc6bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP13896',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 140843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2017}
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-30 05:41:15 [auto1.de] INFO: Saving data for AP13896: {'auction_closing_time': 1774885293.0, 'created_time': 1774553004.246292, 'last_price_update_time': 1774849275.9414}
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP13896') HTTP/1.1" 204 0
2026-03-30 05:41:15 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-30 05:41:15 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-30 05:41:15 [auto1.de] INFO: Scrape type for AP92874: 2
2026-03-30 05:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca367a7b-dfeb-53db-918d-e67be1e1833a with identifier: AP92874
2026-03-30 05:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca367a7b-dfeb-53db-918d-e67be1e1833a with scrape type 2
2026-03-30 05:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca367a7b-dfeb-53db-918d-e67be1e1833a with scrape type 2
2026-03-30 05:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca367a7b-dfeb-53db-918d-e67be1e1833a, identifier: AP92874
2026-03-30 05:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca367a7b-dfeb-53db-918d-e67be1e1833a with identifier: AP92874
2026-03-30 05:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca367a7b-dfeb-53db-918d-e67be1e1833a with identifier: AP92874
2026-03-30 05:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca367a7b-dfeb-53db-918d-e67be1e1833a with identifier: AP92874 to the API
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:23Z',
 'fuel_type': 'petrol',
 'id': 'ca367a7b-dfeb-53db-918d-e67be1e1833a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP92874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 90027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TSI Pritsche Doppelkabine lang',
 'transmission': 'manual',
 'trim': 'Pritsche Doppelkabine lang',
 'year': 2015}
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Saving data for AP92874: {'auction_closing_time': 1774883483.0, 'created_time': 1774639283.505332, 'last_price_update_time': 1774849276.367061}
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP92874') HTTP/1.1" 204 0
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Scrape type for KJ75418: 2
2026-03-30 05:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with identifier: KJ75418
2026-03-30 05:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with scrape type 2
2026-03-30 05:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with scrape type 2
2026-03-30 05:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e23ed95-d912-5f2d-a3d9-aa521cd360cb, identifier: KJ75418
2026-03-30 05:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with identifier: KJ75418
2026-03-30 05:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with identifier: KJ75418
2026-03-30 05:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e23ed95-d912-5f2d-a3d9-aa521cd360cb with identifier: KJ75418 to the API
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'diesel',
 'id': '7e23ed95-d912-5f2d-a3d9-aa521cd360cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ75418',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 279705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang Rise',
 'transmission': 'automatic',
 'trim': 'lang Rise',
 'year': 2018}
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Saving data for KJ75418: {'auction_closing_time': 1774885000.0, 'created_time': 1774639382.435107, 'last_price_update_time': 1774849276.828548}
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ75418') HTTP/1.1" 204 0
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-30 05:41:16 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-30 05:41:16 [auto1.de] INFO: Scrape type for PR23658: 2
2026-03-30 05:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 978b43a4-39f3-5471-adbb-c0f0d50a50cd with identifier: PR23658
2026-03-30 05:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 978b43a4-39f3-5471-adbb-c0f0d50a50cd with scrape type 2
2026-03-30 05:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 978b43a4-39f3-5471-adbb-c0f0d50a50cd with scrape type 2
2026-03-30 05:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 978b43a4-39f3-5471-adbb-c0f0d50a50cd, identifier: PR23658
2026-03-30 05:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 978b43a4-39f3-5471-adbb-c0f0d50a50cd with identifier: PR23658
2026-03-30 05:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 978b43a4-39f3-5471-adbb-c0f0d50a50cd with identifier: PR23658
2026-03-30 05:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 978b43a4-39f3-5471-adbb-c0f0d50a50cd with identifier: PR23658 to the API
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:42:22Z',
 'fuel_type': 'petrol',
 'id': '978b43a4-39f3-5471-adbb-c0f0d50a50cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR23658',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 44523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Saving data for PR23658: {'auction_closing_time': 1774885342.0, 'created_time': 1773303162.386804, 'last_price_update_time': 1774849277.265942}
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR23658') HTTP/1.1" 204 0
2026-03-30 05:41:17 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-30 05:41:17 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-30 05:41:17 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Scrape type for XN42361: 2
2026-03-30 05:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ec5795-cbcb-5ab9-a4b5-1918600a373a with identifier: XN42361
2026-03-30 05:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ec5795-cbcb-5ab9-a4b5-1918600a373a with scrape type 2
2026-03-30 05:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4ec5795-cbcb-5ab9-a4b5-1918600a373a with scrape type 2
2026-03-30 05:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4ec5795-cbcb-5ab9-a4b5-1918600a373a, identifier: XN42361
2026-03-30 05:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4ec5795-cbcb-5ab9-a4b5-1918600a373a with identifier: XN42361
2026-03-30 05:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4ec5795-cbcb-5ab9-a4b5-1918600a373a with identifier: XN42361
2026-03-30 05:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4ec5795-cbcb-5ab9-a4b5-1918600a373a with identifier: XN42361 to the API
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:05:31Z',
 'fuel_type': 'petrol',
 'id': 'b4ec5795-cbcb-5ab9-a4b5-1918600a373a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN42361',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 97032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Saving data for XN42361: {'auction_closing_time': 1774883131.0, 'created_time': 1774638287.946082, 'last_price_update_time': 1774849277.801111}
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN42361') HTTP/1.1" 204 0
2026-03-30 05:41:17 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-30 05:41:17 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-30 05:41:17 [auto1.de] INFO: Scrape type for PF90530: 2
2026-03-30 05:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e7a427-2b1f-5c94-88d6-e886be781351 with identifier: PF90530
2026-03-30 05:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e7a427-2b1f-5c94-88d6-e886be781351 with scrape type 2
2026-03-30 05:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e7a427-2b1f-5c94-88d6-e886be781351 with scrape type 2
2026-03-30 05:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e7a427-2b1f-5c94-88d6-e886be781351, identifier: PF90530
2026-03-30 05:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e7a427-2b1f-5c94-88d6-e886be781351 with identifier: PF90530
2026-03-30 05:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e7a427-2b1f-5c94-88d6-e886be781351 with identifier: PF90530
2026-03-30 05:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e7a427-2b1f-5c94-88d6-e886be781351 with identifier: PF90530 to the API
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:01Z',
 'fuel_type': 'diesel',
 'id': 'f5e7a427-2b1f-5c94-88d6-e886be781351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF90530',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 166283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Saving data for PF90530: {'auction_closing_time': 1774884541.0, 'created_time': 1774033134.416683, 'last_price_update_time': 1774849278.219796}
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF90530') HTTP/1.1" 204 0
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 05:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:18 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for JA93486: 2
2026-03-30 05:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with identifier: JA93486
2026-03-30 05:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with scrape type 2
2026-03-30 05:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with scrape type 2
2026-03-30 05:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61df5d0b-da68-5f70-a3f5-a4cff2947a64, identifier: JA93486
2026-03-30 05:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with identifier: JA93486
2026-03-30 05:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with identifier: JA93486
2026-03-30 05:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61df5d0b-da68-5f70-a3f5-a4cff2947a64 with identifier: JA93486 to the API
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:06Z',
 'fuel_type': 'petrol',
 'id': '61df5d0b-da68-5f70-a3f5-a4cff2947a64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA93486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 214204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Saving data for JA93486: {'auction_closing_time': 1774885326.0, 'created_time': 1774638279.185139, 'last_price_update_time': 1774849278.777283}
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA93486') HTTP/1.1" 204 0
2026-03-30 05:41:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for UC09176: 0
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-30 05:41:18 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-30 05:41:18 [auto1.de] INFO: Scrape type for VY02082: 2
2026-03-30 05:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-30 05:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with scrape type 2
2026-03-30 05:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with scrape type 2
2026-03-30 05:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949, identifier: VY02082
2026-03-30 05:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-30 05:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082
2026-03-30 05:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12bb97f-4f2a-5960-9a45-7fe8ef9d7949 with identifier: VY02082 to the API
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:10:39Z',
 'fuel_type': 'diesel',
 'id': 'e12bb97f-4f2a-5960-9a45-7fe8ef9d7949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY02082',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 131050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 You!',
 'transmission': 'manual',
 'trim': 'You!',
 'year': 2015}
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-30 05:41:19 [auto1.de] INFO: Saving data for VY02082: {'auction_closing_time': 1774883439.0, 'created_time': 1774552595.081643, 'last_price_update_time': 1774849279.30943}
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY02082') HTTP/1.1" 204 0
2026-03-30 05:41:19 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-30 05:41:19 [auto1.de] INFO: Scrape type for HD78649: 2
2026-03-30 05:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7adbff-a658-5167-baad-26524403dcee with identifier: HD78649
2026-03-30 05:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7adbff-a658-5167-baad-26524403dcee with scrape type 2
2026-03-30 05:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7adbff-a658-5167-baad-26524403dcee with scrape type 2
2026-03-30 05:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7adbff-a658-5167-baad-26524403dcee, identifier: HD78649
2026-03-30 05:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7adbff-a658-5167-baad-26524403dcee with identifier: HD78649
2026-03-30 05:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7adbff-a658-5167-baad-26524403dcee with identifier: HD78649
2026-03-30 05:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7adbff-a658-5167-baad-26524403dcee with identifier: HD78649 to the API
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:01:47Z',
 'fuel_type': 'petrol',
 'id': '7f7adbff-a658-5167-baad-26524403dcee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD78649',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 116059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-30 05:41:19 [auto1.de] INFO: Saving data for HD78649: {'auction_closing_time': 1774882907.0, 'created_time': 1774638145.326673, 'last_price_update_time': 1774849279.790472}
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD78649') HTTP/1.1" 204 0
2026-03-30 05:41:19 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-30 05:41:19 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-30 05:41:19 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-30 05:41:19 [auto1.de] INFO: Scrape type for KA69017: 2
2026-03-30 05:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-30 05:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 268e21d8-b8eb-570b-a920-528ea7b04035 with scrape type 2
2026-03-30 05:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 268e21d8-b8eb-570b-a920-528ea7b04035 with scrape type 2
2026-03-30 05:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 268e21d8-b8eb-570b-a920-528ea7b04035, identifier: KA69017
2026-03-30 05:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-30 05:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017
2026-03-30 05:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 268e21d8-b8eb-570b-a920-528ea7b04035 with identifier: KA69017 to the API
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:23Z',
 'fuel_type': 'diesel',
 'id': '268e21d8-b8eb-570b-a920-528ea7b04035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA69017',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 77867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Saving data for KA69017: {'auction_closing_time': 1774883843.0, 'created_time': 1774552442.726586, 'last_price_update_time': 1774849280.203696}
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA69017') HTTP/1.1" 204 0
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Scrape type for UG82717: 2
2026-03-30 05:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec13f717-6d03-5189-ae27-e4bf1b509e45 with identifier: UG82717
2026-03-30 05:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec13f717-6d03-5189-ae27-e4bf1b509e45 with scrape type 2
2026-03-30 05:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec13f717-6d03-5189-ae27-e4bf1b509e45 with scrape type 2
2026-03-30 05:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec13f717-6d03-5189-ae27-e4bf1b509e45, identifier: UG82717
2026-03-30 05:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec13f717-6d03-5189-ae27-e4bf1b509e45 with identifier: UG82717
2026-03-30 05:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec13f717-6d03-5189-ae27-e4bf1b509e45 with identifier: UG82717
2026-03-30 05:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec13f717-6d03-5189-ae27-e4bf1b509e45 with identifier: UG82717 to the API
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:31Z',
 'fuel_type': 'diesel',
 'id': 'ec13f717-6d03-5189-ae27-e4bf1b509e45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG82717',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 243056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Saving data for UG82717: {'auction_closing_time': 1774886191.0, 'created_time': 1774550432.464934, 'last_price_update_time': 1774849280.624195}
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG82717') HTTP/1.1" 204 0
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Scrape type for JH22526: 0
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-30 05:41:20 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-30 05:41:20 [auto1.de] INFO: Scrape type for UG36008: 2
2026-03-30 05:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with identifier: UG36008
2026-03-30 05:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with scrape type 2
2026-03-30 05:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with scrape type 2
2026-03-30 05:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 456e80d8-7948-5ed9-b6b7-fdca48a143a1, identifier: UG36008
2026-03-30 05:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with identifier: UG36008
2026-03-30 05:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with identifier: UG36008
2026-03-30 05:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 456e80d8-7948-5ed9-b6b7-fdca48a143a1 with identifier: UG36008 to the API
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:06:21Z',
 'fuel_type': 'petrol',
 'id': '456e80d8-7948-5ed9-b6b7-fdca48a143a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG36008',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 51834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-30 05:41:21 [auto1.de] INFO: Saving data for UG36008: {'auction_closing_time': 1774883181.0, 'created_time': 1774637646.691802, 'last_price_update_time': 1774849281.09114}
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG36008') HTTP/1.1" 204 0
2026-03-30 05:41:21 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-30 05:41:21 [auto1.de] INFO: Scrape type for TM50766: 2
2026-03-30 05:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c887cf57-0ef2-5bf2-aade-6c689beea876 with identifier: TM50766
2026-03-30 05:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c887cf57-0ef2-5bf2-aade-6c689beea876 with scrape type 2
2026-03-30 05:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c887cf57-0ef2-5bf2-aade-6c689beea876 with scrape type 2
2026-03-30 05:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c887cf57-0ef2-5bf2-aade-6c689beea876, identifier: TM50766
2026-03-30 05:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c887cf57-0ef2-5bf2-aade-6c689beea876 with identifier: TM50766
2026-03-30 05:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c887cf57-0ef2-5bf2-aade-6c689beea876 with identifier: TM50766
2026-03-30 05:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c887cf57-0ef2-5bf2-aade-6c689beea876 with identifier: TM50766 to the API
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:20:34Z',
 'fuel_type': 'hybrid',
 'id': 'c887cf57-0ef2-5bf2-aade-6c689beea876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM50766',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 33593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2022}
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-30 05:41:21 [auto1.de] INFO: Saving data for TM50766: {'auction_closing_time': 1774884034.0, 'created_time': 1774638899.725056, 'last_price_update_time': 1774849281.586749}
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM50766') HTTP/1.1" 204 0
2026-03-30 05:41:21 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-30 05:41:21 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-30 05:41:21 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-30 05:41:21 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-30 05:41:21 [auto1.de] INFO: Scrape type for TG50792: 2
2026-03-30 05:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-30 05:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6c292c-6205-5bfc-aa84-28b431239000 with scrape type 2
2026-03-30 05:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d6c292c-6205-5bfc-aa84-28b431239000 with scrape type 2
2026-03-30 05:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d6c292c-6205-5bfc-aa84-28b431239000, identifier: TG50792
2026-03-30 05:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-30 05:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792
2026-03-30 05:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d6c292c-6205-5bfc-aa84-28b431239000 with identifier: TG50792 to the API
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:20Z',
 'fuel_type': 'diesel',
 'id': '2d6c292c-6205-5bfc-aa84-28b431239000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG50792',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 86833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L5H2 RS: 4035 mm',
 'transmission': 'manual',
 'trim': 'L5H2 RS: 4035 mm',
 'year': 2022}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Saving data for TG50792: {'auction_closing_time': 1774884320.0, 'created_time': 1774552889.239327, 'last_price_update_time': 1774849282.028967}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG50792') HTTP/1.1" 204 0
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for KV45181: 2
2026-03-30 05:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-30 05:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with scrape type 2
2026-03-30 05:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with scrape type 2
2026-03-30 05:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62d52e27-ce30-5fcc-9201-1aa6eadf7521, identifier: KV45181
2026-03-30 05:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-30 05:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181
2026-03-30 05:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62d52e27-ce30-5fcc-9201-1aa6eadf7521 with identifier: KV45181 to the API
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'petrol',
 'id': '62d52e27-ce30-5fcc-9201-1aa6eadf7521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV45181',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 227132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-13',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2005}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Saving data for KV45181: {'auction_closing_time': 1774885388.0, 'created_time': 1774550666.737614, 'last_price_update_time': 1774849282.422721}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV45181') HTTP/1.1" 204 0
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-30 05:41:22 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-30 05:41:22 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Scrape type for LM30127: 2
2026-03-30 05:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-30 05:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61119cb4-a9e1-559e-a654-2bf3e678064b with scrape type 2
2026-03-30 05:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61119cb4-a9e1-559e-a654-2bf3e678064b with scrape type 2
2026-03-30 05:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61119cb4-a9e1-559e-a654-2bf3e678064b, identifier: LM30127
2026-03-30 05:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-30 05:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127
2026-03-30 05:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61119cb4-a9e1-559e-a654-2bf3e678064b with identifier: LM30127 to the API
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:56:21Z',
 'fuel_type': 'petrol',
 'id': '61119cb4-a9e1-559e-a654-2bf3e678064b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM30127',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 145920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2009}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-30 05:41:22 [auto1.de] INFO: Saving data for LM30127: {'auction_closing_time': 1774886181.0, 'created_time': 1774552927.889865, 'last_price_update_time': 1774849282.937285}
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM30127') HTTP/1.1" 204 0
2026-03-30 05:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Scrape type for VX15000: 0
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Scrape type for WK73067: 2
2026-03-30 05:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with identifier: WK73067
2026-03-30 05:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with scrape type 2
2026-03-30 05:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with scrape type 2
2026-03-30 05:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7be601d1-8c7c-5645-ae49-ecca0e89cd33, identifier: WK73067
2026-03-30 05:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with identifier: WK73067
2026-03-30 05:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with identifier: WK73067
2026-03-30 05:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7be601d1-8c7c-5645-ae49-ecca0e89cd33 with identifier: WK73067 to the API
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'diesel',
 'id': '7be601d1-8c7c-5645-ae49-ecca0e89cd33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK73067',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 268643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Saving data for WK73067: {'auction_closing_time': 1774884139.0, 'created_time': 1773660425.945634, 'last_price_update_time': 1774849283.491152}
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK73067') HTTP/1.1" 204 0
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-30 05:41:23 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-30 05:41:23 [auto1.de] INFO: Scrape type for TR29242: 2
2026-03-30 05:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c02ec2-24ea-53f5-ad72-2969472c0b08 with identifier: TR29242
2026-03-30 05:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c02ec2-24ea-53f5-ad72-2969472c0b08 with scrape type 2
2026-03-30 05:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c02ec2-24ea-53f5-ad72-2969472c0b08 with scrape type 2
2026-03-30 05:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c02ec2-24ea-53f5-ad72-2969472c0b08, identifier: TR29242
2026-03-30 05:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c02ec2-24ea-53f5-ad72-2969472c0b08 with identifier: TR29242
2026-03-30 05:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c02ec2-24ea-53f5-ad72-2969472c0b08 with identifier: TR29242
2026-03-30 05:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c02ec2-24ea-53f5-ad72-2969472c0b08 with identifier: TR29242 to the API
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:13:43Z',
 'fuel_type': 'diesel',
 'id': '80c02ec2-24ea-53f5-ad72-2969472c0b08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR29242',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 184396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-24',
 'seller_name': None,
 'title': 'Opel Mokka 1.7 CDTI Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2014}
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Saving data for TR29242: {'auction_closing_time': 1774883623.0, 'created_time': 1773427388.917802, 'last_price_update_time': 1774849284.078757}
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR29242') HTTP/1.1" 204 0
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Scrape type for XE05980: 2
2026-03-30 05:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with identifier: XE05980
2026-03-30 05:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with scrape type 2
2026-03-30 05:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with scrape type 2
2026-03-30 05:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e207ce1b-367c-5bb8-93ba-6e5c9eebfa07, identifier: XE05980
2026-03-30 05:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with identifier: XE05980
2026-03-30 05:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with identifier: XE05980
2026-03-30 05:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e207ce1b-367c-5bb8-93ba-6e5c9eebfa07 with identifier: XE05980 to the API
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:46:46Z',
 'fuel_type': 'petrol',
 'id': 'e207ce1b-367c-5bb8-93ba-6e5c9eebfa07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE05980',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 130953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-02',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Saving data for XE05980: {'auction_closing_time': 1774885606.0, 'created_time': 1774639259.028666, 'last_price_update_time': 1774849284.558214}
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE05980') HTTP/1.1" 204 0
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-30 05:41:24 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-30 05:41:24 [auto1.de] INFO: Scrape type for ND58698: 2
2026-03-30 05:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3883133-ce8b-5743-b628-58a1ddf20e86 with identifier: ND58698
2026-03-30 05:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3883133-ce8b-5743-b628-58a1ddf20e86 with scrape type 2
2026-03-30 05:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3883133-ce8b-5743-b628-58a1ddf20e86 with scrape type 2
2026-03-30 05:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3883133-ce8b-5743-b628-58a1ddf20e86, identifier: ND58698
2026-03-30 05:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3883133-ce8b-5743-b628-58a1ddf20e86 with identifier: ND58698
2026-03-30 05:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3883133-ce8b-5743-b628-58a1ddf20e86 with identifier: ND58698
2026-03-30 05:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3883133-ce8b-5743-b628-58a1ddf20e86 with identifier: ND58698 to the API
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:21:59Z',
 'fuel_type': 'petrol',
 'id': 'c3883133-ce8b-5743-b628-58a1ddf20e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND58698',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 252750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-04-15',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 5.2 V8 Ltd.',
 'transmission': 'automatic',
 'trim': 'Ltd.',
 'year': 1997}
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-30 05:41:25 [auto1.de] INFO: Saving data for ND58698: {'auction_closing_time': 1774884119.0, 'created_time': 1774549843.462598, 'last_price_update_time': 1774849285.0711}
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND58698') HTTP/1.1" 204 0
2026-03-30 05:41:25 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-30 05:41:25 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-30 05:41:25 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-30 05:41:25 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-30 05:41:25 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-30 05:41:25 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-30 05:41:25 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-30 05:41:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:26 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for YM60509: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for XK59182: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for UL30875: 2
2026-03-30 05:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be197b7b-8e2e-5377-b3c0-20916c994b97 with identifier: UL30875
2026-03-30 05:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be197b7b-8e2e-5377-b3c0-20916c994b97 with scrape type 2
2026-03-30 05:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be197b7b-8e2e-5377-b3c0-20916c994b97 with scrape type 2
2026-03-30 05:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be197b7b-8e2e-5377-b3c0-20916c994b97, identifier: UL30875
2026-03-30 05:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be197b7b-8e2e-5377-b3c0-20916c994b97 with identifier: UL30875
2026-03-30 05:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be197b7b-8e2e-5377-b3c0-20916c994b97 with identifier: UL30875
2026-03-30 05:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be197b7b-8e2e-5377-b3c0-20916c994b97 with identifier: UL30875 to the API
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:25:40Z',
 'fuel_type': 'petrol',
 'id': 'be197b7b-8e2e-5377-b3c0-20916c994b97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL30875',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 169632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Saving data for UL30875: {'auction_closing_time': 1774884340.0, 'created_time': 1774639200.723545, 'last_price_update_time': 1774849286.497154}
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL30875') HTTP/1.1" 204 0
2026-03-30 05:41:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for GT00768: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for MR38870: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for ZN01973: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-30 05:41:26 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-30 05:41:26 [auto1.de] INFO: Scrape type for VY67119: 2
2026-03-30 05:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c811660e-47d8-50bc-8bfc-4808800ad521 with identifier: VY67119
2026-03-30 05:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c811660e-47d8-50bc-8bfc-4808800ad521 with scrape type 2
2026-03-30 05:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c811660e-47d8-50bc-8bfc-4808800ad521 with scrape type 2
2026-03-30 05:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c811660e-47d8-50bc-8bfc-4808800ad521, identifier: VY67119
2026-03-30 05:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c811660e-47d8-50bc-8bfc-4808800ad521 with identifier: VY67119
2026-03-30 05:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c811660e-47d8-50bc-8bfc-4808800ad521 with identifier: VY67119
2026-03-30 05:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c811660e-47d8-50bc-8bfc-4808800ad521 with identifier: VY67119 to the API
2026-03-30 05:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:18:51Z',
 'fuel_type': 'diesel',
 'id': 'c811660e-47d8-50bc-8bfc-4808800ad521',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67119',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 88351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Limited',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Limited',
 'year': 2022}
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-30 05:41:27 [auto1.de] INFO: Saving data for VY67119: {'auction_closing_time': 1774883931.0, 'created_time': 1774638594.062076, 'last_price_update_time': 1774849287.107529}
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY67119') HTTP/1.1" 204 0
2026-03-30 05:41:27 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-30 05:41:27 [auto1.de] INFO: Scrape type for UX52309: 2
2026-03-30 05:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with identifier: UX52309
2026-03-30 05:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with scrape type 2
2026-03-30 05:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with scrape type 2
2026-03-30 05:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16222500-34a7-5cc2-b5c8-5192d2e1fd37, identifier: UX52309
2026-03-30 05:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with identifier: UX52309
2026-03-30 05:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with identifier: UX52309
2026-03-30 05:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16222500-34a7-5cc2-b5c8-5192d2e1fd37 with identifier: UX52309 to the API
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:57:36Z',
 'fuel_type': 'diesel',
 'id': '16222500-34a7-5cc2-b5c8-5192d2e1fd37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX52309',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 320850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2005}
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-30 05:41:27 [auto1.de] INFO: Saving data for UX52309: {'auction_closing_time': 1774886256.0, 'created_time': 1774639207.145844, 'last_price_update_time': 1774849287.615768}
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX52309') HTTP/1.1" 204 0
2026-03-30 05:41:27 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-30 05:41:27 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-30 05:41:27 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-30 05:41:27 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-30 05:41:27 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-30 05:41:27 [auto1.de] INFO: Scrape type for XS74936: 2
2026-03-30 05:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with identifier: XS74936
2026-03-30 05:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with scrape type 2
2026-03-30 05:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with scrape type 2
2026-03-30 05:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a081e6d0-597b-5b72-a7d3-c59fd59ae4e1, identifier: XS74936
2026-03-30 05:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with identifier: XS74936
2026-03-30 05:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with identifier: XS74936
2026-03-30 05:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a081e6d0-597b-5b72-a7d3-c59fd59ae4e1 with identifier: XS74936 to the API
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:58:25Z',
 'fuel_type': 'diesel',
 'id': 'a081e6d0-597b-5b72-a7d3-c59fd59ae4e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS74936',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 179966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-30 05:41:28 [auto1.de] INFO: Saving data for XS74936: {'auction_closing_time': 1774886305.0, 'created_time': 1774031913.916982, 'last_price_update_time': 1774849288.028232}
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS74936') HTTP/1.1" 204 0
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-30 05:41:28 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-30 05:41:28 [auto1.de] INFO: Scrape type for PT52067: 0
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-30 05:41:28 [auto1.de] INFO: Scrape type for PX71275: 2
2026-03-30 05:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6018808f-3e60-5c7f-9197-98c2f5b40d39 with identifier: PX71275
2026-03-30 05:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6018808f-3e60-5c7f-9197-98c2f5b40d39 with scrape type 2
2026-03-30 05:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6018808f-3e60-5c7f-9197-98c2f5b40d39 with scrape type 2
2026-03-30 05:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6018808f-3e60-5c7f-9197-98c2f5b40d39, identifier: PX71275
2026-03-30 05:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6018808f-3e60-5c7f-9197-98c2f5b40d39 with identifier: PX71275
2026-03-30 05:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6018808f-3e60-5c7f-9197-98c2f5b40d39 with identifier: PX71275
2026-03-30 05:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6018808f-3e60-5c7f-9197-98c2f5b40d39 with identifier: PX71275 to the API
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:00Z',
 'fuel_type': 'diesel',
 'id': '6018808f-3e60-5c7f-9197-98c2f5b40d39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX71275',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 331061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2012}
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-30 05:41:28 [auto1.de] INFO: Saving data for PX71275: {'auction_closing_time': 1774885440.0, 'created_time': 1774638586.513475, 'last_price_update_time': 1774849288.524483}
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX71275') HTTP/1.1" 204 0
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-30 05:41:28 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-30 05:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:29 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-30 05:41:29 [auto1.de] INFO: Scrape type for EC44311: 2
2026-03-30 05:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-30 05:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267bab6c-3fd3-569f-8c88-4983414091f9 with scrape type 2
2026-03-30 05:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267bab6c-3fd3-569f-8c88-4983414091f9 with scrape type 2
2026-03-30 05:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267bab6c-3fd3-569f-8c88-4983414091f9, identifier: EC44311
2026-03-30 05:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-30 05:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311
2026-03-30 05:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267bab6c-3fd3-569f-8c88-4983414091f9 with identifier: EC44311 to the API
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:16:05Z',
 'fuel_type': 'petrol',
 'id': '267bab6c-3fd3-569f-8c88-4983414091f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC44311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 42584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-14',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2023}
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-30 05:41:29 [auto1.de] INFO: Saving data for EC44311: {'auction_closing_time': 1774883765.0, 'created_time': 1774589445.905279, 'last_price_update_time': 1774849289.853416}
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC44311') HTTP/1.1" 204 0
2026-03-30 05:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-30 05:41:29 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-30 05:41:29 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-30 05:41:29 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Scrape type for LG11243: 2
2026-03-30 05:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with identifier: LG11243
2026-03-30 05:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff, identifier: LG11243
2026-03-30 05:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with identifier: LG11243
2026-03-30 05:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with identifier: LG11243
2026-03-30 05:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff with identifier: LG11243 to the API
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:16:57Z',
 'fuel_type': 'diesel',
 'id': '3aaa2fa6-cdd0-54c3-af49-3d72a731f8ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG11243',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 222619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-23',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Saving data for LG11243: {'auction_closing_time': 1774883817.0, 'created_time': 1774549893.757384, 'last_price_update_time': 1774849290.395917}
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG11243') HTTP/1.1" 204 0
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Scrape type for BP44038: 2
2026-03-30 05:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae723948-7ede-5d92-bd76-062a6856f217 with identifier: BP44038
2026-03-30 05:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae723948-7ede-5d92-bd76-062a6856f217 with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae723948-7ede-5d92-bd76-062a6856f217 with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae723948-7ede-5d92-bd76-062a6856f217, identifier: BP44038
2026-03-30 05:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae723948-7ede-5d92-bd76-062a6856f217 with identifier: BP44038
2026-03-30 05:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae723948-7ede-5d92-bd76-062a6856f217 with identifier: BP44038
2026-03-30 05:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae723948-7ede-5d92-bd76-062a6856f217 with identifier: BP44038 to the API
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:38:07Z',
 'fuel_type': 'petrol',
 'id': 'ae723948-7ede-5d92-bd76-062a6856f217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP44038',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 43455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-29',
 'seller_name': None,
 'title': 'Dacia Sandero 1.4 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2009}
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Saving data for BP44038: {'auction_closing_time': 1774885087.0, 'created_time': 1774637234.022245, 'last_price_update_time': 1774849290.821307}
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP44038') HTTP/1.1" 204 0
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-30 05:41:30 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-30 05:41:30 [auto1.de] INFO: Scrape type for GJ71101: 2
2026-03-30 05:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abe2436-21c7-5688-8aca-ed5020da5545 with identifier: GJ71101
2026-03-30 05:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9abe2436-21c7-5688-8aca-ed5020da5545 with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9abe2436-21c7-5688-8aca-ed5020da5545 with scrape type 2
2026-03-30 05:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9abe2436-21c7-5688-8aca-ed5020da5545, identifier: GJ71101
2026-03-30 05:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9abe2436-21c7-5688-8aca-ed5020da5545 with identifier: GJ71101
2026-03-30 05:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9abe2436-21c7-5688-8aca-ed5020da5545 with identifier: GJ71101
2026-03-30 05:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9abe2436-21c7-5688-8aca-ed5020da5545 with identifier: GJ71101 to the API
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-30T15:37:27Z',
 'fuel_type': 'petrol',
 'id': '9abe2436-21c7-5688-8aca-ed5020da5545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71101',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 189250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-07',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Streetline Club',
 'transmission': 'manual',
 'trim': 'Streetline Club',
 'year': 2007}
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-30 05:41:31 [auto1.de] INFO: Saving data for GJ71101: {'auction_closing_time': 1774885047.0, 'created_time': 1774637127.613715, 'last_price_update_time': 1774849291.558221}
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71101') HTTP/1.1" 204 0
2026-03-30 05:41:31 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-30 05:41:31 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-30 05:41:31 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-30 05:41:31 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-30 05:41:31 [auto1.de] INFO: Scrape type for UA95146: 2
2026-03-30 05:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cec62b-b982-522b-88aa-f087189502e0 with identifier: UA95146
2026-03-30 05:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cec62b-b982-522b-88aa-f087189502e0 with scrape type 2
2026-03-30 05:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3cec62b-b982-522b-88aa-f087189502e0 with scrape type 2
2026-03-30 05:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3cec62b-b982-522b-88aa-f087189502e0, identifier: UA95146
2026-03-30 05:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3cec62b-b982-522b-88aa-f087189502e0 with identifier: UA95146
2026-03-30 05:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3cec62b-b982-522b-88aa-f087189502e0 with identifier: UA95146
2026-03-30 05:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3cec62b-b982-522b-88aa-f087189502e0 with identifier: UA95146 to the API
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'diesel',
 'id': 'b3cec62b-b982-522b-88aa-f087189502e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA95146',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 202702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Active Start/Stop',
 'transmission': 'automatic',
 'trim': 'Active Start/Stop',
 'year': 2017}
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Saving data for UA95146: {'auction_closing_time': 1774883898.0, 'created_time': 1774549878.547147, 'last_price_update_time': 1774849292.09418}
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA95146') HTTP/1.1" 204 0
2026-03-30 05:41:32 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Scrape type for GG27070: 2
2026-03-30 05:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53bcb597-81e2-5af6-a108-3c93b73bf276 with identifier: GG27070
2026-03-30 05:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53bcb597-81e2-5af6-a108-3c93b73bf276 with scrape type 2
2026-03-30 05:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53bcb597-81e2-5af6-a108-3c93b73bf276 with scrape type 2
2026-03-30 05:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53bcb597-81e2-5af6-a108-3c93b73bf276, identifier: GG27070
2026-03-30 05:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53bcb597-81e2-5af6-a108-3c93b73bf276 with identifier: GG27070
2026-03-30 05:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53bcb597-81e2-5af6-a108-3c93b73bf276 with identifier: GG27070
2026-03-30 05:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53bcb597-81e2-5af6-a108-3c93b73bf276 with identifier: GG27070 to the API
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:59Z',
 'fuel_type': 'petrol',
 'id': '53bcb597-81e2-5af6-a108-3c93b73bf276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG27070',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 96219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2013}
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Saving data for GG27070: {'auction_closing_time': 1774883279.0, 'created_time': 1774521342.946447, 'last_price_update_time': 1774849292.502484}
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG27070') HTTP/1.1" 204 0
2026-03-30 05:41:32 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-30 05:41:32 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-30 05:41:32 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Scrape type for RC84625: 2
2026-03-30 05:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-30 05:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with scrape type 2
2026-03-30 05:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with scrape type 2
2026-03-30 05:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8, identifier: RC84625
2026-03-30 05:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-30 05:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625
2026-03-30 05:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d76da2a2-8d5c-5308-8cf3-b340b32cf1a8 with identifier: RC84625 to the API
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:28:50Z',
 'fuel_type': 'petrol',
 'id': 'd76da2a2-8d5c-5308-8cf3-b340b32cf1a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC84625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 10871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-30 05:41:32 [auto1.de] INFO: Saving data for RC84625: {'auction_closing_time': 1774884530.0, 'created_time': 1774552876.275173, 'last_price_update_time': 1774849292.999189}
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC84625') HTTP/1.1" 204 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for VF40931: 2
2026-03-30 05:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-30 05:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d7f332-a997-52c8-959b-d8896938f7e6 with scrape type 2
2026-03-30 05:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84d7f332-a997-52c8-959b-d8896938f7e6 with scrape type 2
2026-03-30 05:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84d7f332-a997-52c8-959b-d8896938f7e6, identifier: VF40931
2026-03-30 05:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-30 05:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931
2026-03-30 05:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84d7f332-a997-52c8-959b-d8896938f7e6 with identifier: VF40931 to the API
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:24:40Z',
 'fuel_type': 'petrol',
 'id': '84d7f332-a997-52c8-959b-d8896938f7e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF40931',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 59314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'automatic',
 'trim': 'Stepway Prestige',
 'year': 2017}
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Saving data for VF40931: {'auction_closing_time': 1774884280.0, 'created_time': 1774552354.334995, 'last_price_update_time': 1774849293.421218}
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF40931') HTTP/1.1" 204 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for HD35365: 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-30 05:41:33 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-30 05:41:33 [auto1.de] INFO: Scrape type for CU13937: 2
2026-03-30 05:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3a84ac-8886-5dd5-87fb-c8084422eb82 with identifier: CU13937
2026-03-30 05:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3a84ac-8886-5dd5-87fb-c8084422eb82 with scrape type 2
2026-03-30 05:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3a84ac-8886-5dd5-87fb-c8084422eb82 with scrape type 2
2026-03-30 05:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea3a84ac-8886-5dd5-87fb-c8084422eb82, identifier: CU13937
2026-03-30 05:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea3a84ac-8886-5dd5-87fb-c8084422eb82 with identifier: CU13937
2026-03-30 05:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea3a84ac-8886-5dd5-87fb-c8084422eb82 with identifier: CU13937
2026-03-30 05:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea3a84ac-8886-5dd5-87fb-c8084422eb82 with identifier: CU13937 to the API
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:20:56Z',
 'fuel_type': 'petrol',
 'id': 'ea3a84ac-8886-5dd5-87fb-c8084422eb82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU13937',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 174109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-17',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Saving data for CU13937: {'auction_closing_time': 1774884056.0, 'created_time': 1774549884.026016, 'last_price_update_time': 1774849294.001478}
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU13937') HTTP/1.1" 204 0
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for GL30880: 2
2026-03-30 05:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c1cdeac-01ed-5737-a871-c44269aa9797 with identifier: GL30880
2026-03-30 05:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c1cdeac-01ed-5737-a871-c44269aa9797 with scrape type 2
2026-03-30 05:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c1cdeac-01ed-5737-a871-c44269aa9797 with scrape type 2
2026-03-30 05:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c1cdeac-01ed-5737-a871-c44269aa9797, identifier: GL30880
2026-03-30 05:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c1cdeac-01ed-5737-a871-c44269aa9797 with identifier: GL30880
2026-03-30 05:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c1cdeac-01ed-5737-a871-c44269aa9797 with identifier: GL30880
2026-03-30 05:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c1cdeac-01ed-5737-a871-c44269aa9797 with identifier: GL30880 to the API
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:41:54Z',
 'fuel_type': 'petrol',
 'id': '7c1cdeac-01ed-5737-a871-c44269aa9797',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL30880',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 58776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-13',
 'seller_name': None,
 'title': 'MINI Countryman Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Saving data for GL30880: {'auction_closing_time': 1774885314.0, 'created_time': 1774637286.587192, 'last_price_update_time': 1774849294.425123}
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL30880') HTTP/1.1" 204 0
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-30 05:41:34 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 05:41:34 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Scrape type for ZF63164: 2
2026-03-30 05:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-30 05:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af646335-8a1a-524c-af12-7483d0ac11e2 with scrape type 2
2026-03-30 05:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af646335-8a1a-524c-af12-7483d0ac11e2 with scrape type 2
2026-03-30 05:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af646335-8a1a-524c-af12-7483d0ac11e2, identifier: ZF63164
2026-03-30 05:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-30 05:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164
2026-03-30 05:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af646335-8a1a-524c-af12-7483d0ac11e2 with identifier: ZF63164 to the API
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'petrol',
 'id': 'af646335-8a1a-524c-af12-7483d0ac11e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF63164',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 98907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-02',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2017}
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-30 05:41:34 [auto1.de] INFO: Saving data for ZF63164: {'auction_closing_time': 1774885309.0, 'created_time': 1774553046.294635, 'last_price_update_time': 1774849294.918399}
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF63164') HTTP/1.1" 204 0
2026-03-30 05:41:35 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Scrape type for SR33990: 0
2026-03-30 05:41:35 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Scrape type for GM00936: 2
2026-03-30 05:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-30 05:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with scrape type 2
2026-03-30 05:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with scrape type 2
2026-03-30 05:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab, identifier: GM00936
2026-03-30 05:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-30 05:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936
2026-03-30 05:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ec060c8-b1b5-56eb-931d-2f61ccb741ab with identifier: GM00936 to the API
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:58:08Z',
 'fuel_type': 'petrol',
 'id': '6ec060c8-b1b5-56eb-931d-2f61ccb741ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM00936',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 160175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-17',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2006}
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Saving data for GM00936: {'auction_closing_time': 1774886288.0, 'created_time': 1774550987.215812, 'last_price_update_time': 1774849295.497889}
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM00936') HTTP/1.1" 204 0
2026-03-30 05:41:35 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Scrape type for MA09266: 2
2026-03-30 05:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5ada6c-ba2d-5489-844e-200c5e827e54 with identifier: MA09266
2026-03-30 05:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5ada6c-ba2d-5489-844e-200c5e827e54 with scrape type 2
2026-03-30 05:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5ada6c-ba2d-5489-844e-200c5e827e54 with scrape type 2
2026-03-30 05:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5ada6c-ba2d-5489-844e-200c5e827e54, identifier: MA09266
2026-03-30 05:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5ada6c-ba2d-5489-844e-200c5e827e54 with identifier: MA09266
2026-03-30 05:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5ada6c-ba2d-5489-844e-200c5e827e54 with identifier: MA09266
2026-03-30 05:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5ada6c-ba2d-5489-844e-200c5e827e54 with identifier: MA09266 to the API
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:57Z',
 'fuel_type': 'diesel',
 'id': 'dd5ada6c-ba2d-5489-844e-200c5e827e54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA09266',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 170992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-02',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Saving data for MA09266: {'auction_closing_time': 1774883277.0, 'created_time': 1773660234.654335, 'last_price_update_time': 1774849295.934314}
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA09266') HTTP/1.1" 204 0
2026-03-30 05:41:35 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-30 05:41:35 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-30 05:41:35 [auto1.de] INFO: Scrape type for RW93776: 2
2026-03-30 05:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-30 05:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8101ca-0c25-56ac-a33f-8024d6a8340b with scrape type 2
2026-03-30 05:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e8101ca-0c25-56ac-a33f-8024d6a8340b with scrape type 2
2026-03-30 05:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e8101ca-0c25-56ac-a33f-8024d6a8340b, identifier: RW93776
2026-03-30 05:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-30 05:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776
2026-03-30 05:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e8101ca-0c25-56ac-a33f-8024d6a8340b with identifier: RW93776 to the API
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:23:54Z',
 'fuel_type': 'petrol',
 'id': '4e8101ca-0c25-56ac-a33f-8024d6a8340b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW93776',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 126247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-02',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2018}
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-30 05:41:36 [auto1.de] INFO: Saving data for RW93776: {'auction_closing_time': 1774884234.0, 'created_time': 1774552100.884535, 'last_price_update_time': 1774849296.352808}
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW93776') HTTP/1.1" 204 0
2026-03-30 05:41:36 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-30 05:41:36 [auto1.de] INFO: Scrape type for NF13899: 2
2026-03-30 05:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-03-30 05:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with scrape type 2
2026-03-30 05:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with scrape type 2
2026-03-30 05:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356, identifier: NF13899
2026-03-30 05:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-03-30 05:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899
2026-03-30 05:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356 with identifier: NF13899 to the API
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:04:05Z',
 'fuel_type': 'diesel',
 'id': '7a4f69e9-6cf1-5d72-9b23-c7dd42c3f356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF13899',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 233503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2016}
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-30 05:41:36 [auto1.de] INFO: Saving data for NF13899: {'auction_closing_time': 1774883045.0, 'created_time': 1774032510.013476, 'last_price_update_time': 1774849296.780281}
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF13899') HTTP/1.1" 204 0
2026-03-30 05:41:36 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-30 05:41:36 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-30 05:41:36 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-30 05:41:36 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-30 05:41:36 [auto1.de] INFO: Scrape type for SD88360: 2
2026-03-30 05:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-30 05:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08b9843-95be-5d3c-bb0c-fbc008695d2c with scrape type 2
2026-03-30 05:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08b9843-95be-5d3c-bb0c-fbc008695d2c with scrape type 2
2026-03-30 05:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c08b9843-95be-5d3c-bb0c-fbc008695d2c, identifier: SD88360
2026-03-30 05:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-30 05:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360
2026-03-30 05:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c08b9843-95be-5d3c-bb0c-fbc008695d2c with identifier: SD88360 to the API
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:44:14Z',
 'fuel_type': 'petrol',
 'id': 'c08b9843-95be-5d3c-bb0c-fbc008695d2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD88360',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 121816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Saving data for SD88360: {'auction_closing_time': 1774885454.0, 'created_time': 1773303151.567717, 'last_price_update_time': 1774849297.207365}
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD88360') HTTP/1.1" 204 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for DF28851: 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for XX31179: 2
2026-03-30 05:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0270775c-e014-5aac-b495-3d09c15155e9 with identifier: XX31179
2026-03-30 05:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0270775c-e014-5aac-b495-3d09c15155e9 with scrape type 2
2026-03-30 05:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0270775c-e014-5aac-b495-3d09c15155e9 with scrape type 2
2026-03-30 05:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0270775c-e014-5aac-b495-3d09c15155e9, identifier: XX31179
2026-03-30 05:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0270775c-e014-5aac-b495-3d09c15155e9 with identifier: XX31179
2026-03-30 05:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0270775c-e014-5aac-b495-3d09c15155e9 with identifier: XX31179
2026-03-30 05:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0270775c-e014-5aac-b495-3d09c15155e9 with identifier: XX31179 to the API
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:33:59Z',
 'fuel_type': 'diesel',
 'id': '0270775c-e014-5aac-b495-3d09c15155e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX31179',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 92738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Saving data for XX31179: {'auction_closing_time': 1774884839.0, 'created_time': 1774637354.733287, 'last_price_update_time': 1774849297.717093}
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX31179') HTTP/1.1" 204 0
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 05:41:37 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 05:41:37 [auto1.de] INFO: Scrape type for UC83378: 2
2026-03-30 05:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79321439-cebe-58b5-abb6-bc7b68bea47a with identifier: UC83378
2026-03-30 05:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79321439-cebe-58b5-abb6-bc7b68bea47a with scrape type 2
2026-03-30 05:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79321439-cebe-58b5-abb6-bc7b68bea47a with scrape type 2
2026-03-30 05:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79321439-cebe-58b5-abb6-bc7b68bea47a, identifier: UC83378
2026-03-30 05:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79321439-cebe-58b5-abb6-bc7b68bea47a with identifier: UC83378
2026-03-30 05:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79321439-cebe-58b5-abb6-bc7b68bea47a with identifier: UC83378
2026-03-30 05:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79321439-cebe-58b5-abb6-bc7b68bea47a with identifier: UC83378 to the API
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:58:15Z',
 'fuel_type': 'petrol',
 'id': '79321439-cebe-58b5-abb6-bc7b68bea47a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC83378',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 91140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S Highgate',
 'transmission': 'automatic',
 'trim': 'Highgate',
 'year': 2015}
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Saving data for UC83378: {'auction_closing_time': 1774886295.0, 'created_time': 1774637238.484373, 'last_price_update_time': 1774849298.227344}
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC83378') HTTP/1.1" 204 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for CF68220: 2
2026-03-30 05:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b6af32-7458-5691-ab1c-1c8933cb25a4 with identifier: CF68220
2026-03-30 05:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b6af32-7458-5691-ab1c-1c8933cb25a4 with scrape type 2
2026-03-30 05:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b6af32-7458-5691-ab1c-1c8933cb25a4 with scrape type 2
2026-03-30 05:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b6af32-7458-5691-ab1c-1c8933cb25a4, identifier: CF68220
2026-03-30 05:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b6af32-7458-5691-ab1c-1c8933cb25a4 with identifier: CF68220
2026-03-30 05:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b6af32-7458-5691-ab1c-1c8933cb25a4 with identifier: CF68220
2026-03-30 05:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b6af32-7458-5691-ab1c-1c8933cb25a4 with identifier: CF68220 to the API
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:28:13Z',
 'fuel_type': 'petrol',
 'id': '71b6af32-7458-5691-ab1c-1c8933cb25a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF68220',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 20267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-09',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Saving data for CF68220: {'auction_closing_time': 1774884493.0, 'created_time': 1774549892.9205, 'last_price_update_time': 1774849298.672359}
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF68220') HTTP/1.1" 204 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for ZA74026: 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for SP00408: 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for GC30737: 0
2026-03-30 05:41:38 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-30 05:41:38 [auto1.de] INFO: Scrape type for GB76211: 0
2026-03-30 05:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:39 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-30 05:41:39 [auto1.de] INFO: Scrape type for EC58383: 2
2026-03-30 05:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6629172b-d441-5677-aa9e-6847bad7cbff with identifier: EC58383
2026-03-30 05:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6629172b-d441-5677-aa9e-6847bad7cbff with scrape type 2
2026-03-30 05:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6629172b-d441-5677-aa9e-6847bad7cbff with scrape type 2
2026-03-30 05:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6629172b-d441-5677-aa9e-6847bad7cbff, identifier: EC58383
2026-03-30 05:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6629172b-d441-5677-aa9e-6847bad7cbff with identifier: EC58383
2026-03-30 05:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6629172b-d441-5677-aa9e-6847bad7cbff with identifier: EC58383
2026-03-30 05:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6629172b-d441-5677-aa9e-6847bad7cbff with identifier: EC58383 to the API
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:26:08Z',
 'fuel_type': 'diesel',
 'id': '6629172b-d441-5677-aa9e-6847bad7cbff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC58383',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 92300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-14',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line AWD',
 'transmission': 'automatic',
 'trim': 'ST-Line AWD',
 'year': 2021}
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-30 05:41:39 [auto1.de] INFO: Saving data for EC58383: {'auction_closing_time': 1774884368.0, 'created_time': 1774637342.533039, 'last_price_update_time': 1774849299.787023}
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC58383') HTTP/1.1" 204 0
2026-03-30 05:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-30 05:41:39 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-30 05:41:39 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-30 05:41:39 [auto1.de] INFO: Scrape type for TM06695: 2
2026-03-30 05:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e36de88-5272-5bcf-9f1a-8603de35d224 with identifier: TM06695
2026-03-30 05:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e36de88-5272-5bcf-9f1a-8603de35d224 with scrape type 2
2026-03-30 05:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e36de88-5272-5bcf-9f1a-8603de35d224 with scrape type 2
2026-03-30 05:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e36de88-5272-5bcf-9f1a-8603de35d224, identifier: TM06695
2026-03-30 05:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e36de88-5272-5bcf-9f1a-8603de35d224 with identifier: TM06695
2026-03-30 05:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e36de88-5272-5bcf-9f1a-8603de35d224 with identifier: TM06695
2026-03-30 05:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e36de88-5272-5bcf-9f1a-8603de35d224 with identifier: TM06695 to the API
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:25:42Z',
 'fuel_type': 'hybrid',
 'id': '1e36de88-5272-5bcf-9f1a-8603de35d224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM06695',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 41598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid N Line 4WD',
 'transmission': 'automatic',
 'trim': 'N Line 4WD',
 'year': 2022}
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Saving data for TM06695: {'auction_closing_time': 1774884342.0, 'created_time': 1773305132.22161, 'last_price_update_time': 1774849300.429369}
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM06695') HTTP/1.1" 204 0
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Scrape type for ST45837: 2
2026-03-30 05:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-30 05:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with scrape type 2
2026-03-30 05:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with scrape type 2
2026-03-30 05:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6, identifier: ST45837
2026-03-30 05:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-30 05:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837
2026-03-30 05:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d70d1ce-c01e-5b5e-9335-2e734d29e1c6 with identifier: ST45837 to the API
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:32Z',
 'fuel_type': 'diesel',
 'id': '3d70d1ce-c01e-5b5e-9335-2e734d29e1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST45837',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 63109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six FWD',
 'transmission': 'manual',
 'trim': 'Generation Six FWD',
 'year': 2020}
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Saving data for ST45837: {'auction_closing_time': 1774885712.0, 'created_time': 1774550634.504006, 'last_price_update_time': 1774849300.839212}
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST45837') HTTP/1.1" 204 0
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Scrape type for JU26227: 0
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-30 05:41:40 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-30 05:41:40 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-30 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Scrape type for GV67460: 0
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Scrape type for NZ17394: 2
2026-03-30 05:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a56d62-650c-5f23-81c7-e15ce57802a9 with identifier: NZ17394
2026-03-30 05:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a56d62-650c-5f23-81c7-e15ce57802a9 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6a56d62-650c-5f23-81c7-e15ce57802a9 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6a56d62-650c-5f23-81c7-e15ce57802a9, identifier: NZ17394
2026-03-30 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6a56d62-650c-5f23-81c7-e15ce57802a9 with identifier: NZ17394
2026-03-30 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6a56d62-650c-5f23-81c7-e15ce57802a9 with identifier: NZ17394
2026-03-30 05:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6a56d62-650c-5f23-81c7-e15ce57802a9 with identifier: NZ17394 to the API
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:28:52Z',
 'fuel_type': 'petrol',
 'id': 'b6a56d62-650c-5f23-81c7-e15ce57802a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ17394',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 283244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-03',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2016}
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Saving data for NZ17394: {'auction_closing_time': 1774884532.0, 'created_time': 1773946067.208317, 'last_price_update_time': 1774849301.408804}
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ17394') HTTP/1.1" 204 0
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Scrape type for GH92253: 2
2026-03-30 05:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with identifier: GH92253
2026-03-30 05:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203, identifier: GH92253
2026-03-30 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with identifier: GH92253
2026-03-30 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with identifier: GH92253
2026-03-30 05:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77f3cc76-8fdb-5f73-9d6d-e7d0c7673203 with identifier: GH92253 to the API
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:08:19Z',
 'fuel_type': 'petrol',
 'id': '77f3cc76-8fdb-5f73-9d6d-e7d0c7673203',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH92253',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 82256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2017}
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Saving data for GH92253: {'auction_closing_time': 1774883299.0, 'created_time': 1774349609.152977, 'last_price_update_time': 1774849301.814913}
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH92253') HTTP/1.1" 204 0
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 05:41:41 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-30 05:41:41 [auto1.de] INFO: Scrape type for VT94173: 2
2026-03-30 05:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9b48cb-e1dc-5a34-810b-995d16d10b82 with identifier: VT94173
2026-03-30 05:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9b48cb-e1dc-5a34-810b-995d16d10b82 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9b48cb-e1dc-5a34-810b-995d16d10b82 with scrape type 2
2026-03-30 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9b48cb-e1dc-5a34-810b-995d16d10b82, identifier: VT94173
2026-03-30 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9b48cb-e1dc-5a34-810b-995d16d10b82 with identifier: VT94173
2026-03-30 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9b48cb-e1dc-5a34-810b-995d16d10b82 with identifier: VT94173
2026-03-30 05:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9b48cb-e1dc-5a34-810b-995d16d10b82 with identifier: VT94173 to the API
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 05:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:09:57Z',
 'fuel_type': 'petrol',
 'id': 'ef9b48cb-e1dc-5a34-810b-995d16d10b82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT94173',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 40751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-29',
 'seller_name': None,
 'title': 'Renault Clio 1.6 Edition Dynamique',
 'transmission': 'automatic',
 'trim': 'Edition Dynamique',
 'year': 2008}
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Saving data for VT94173: {'auction_closing_time': 1774883397.0, 'created_time': 1774637959.385654, 'last_price_update_time': 1774849302.2265}
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT94173') HTTP/1.1" 204 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for MY90175: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for NH48980: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for UZ14919: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for KC56991: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for SP37211: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for ZJ20785: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for HJ15324: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 05:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:42 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for NL79635: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for DP76469: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for LU20114: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for MA38279: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for PZ30496: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for CH12661: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for HC35889: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for ZM69821: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for KF80964: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for KR40526: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for NS83554: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for UV09635: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for LR83897: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for EX09851: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for RT47788: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for NF65308: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for RB21288: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-30 05:41:42 [auto1.de] INFO: Scrape type for TL00985: 0
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-30 05:41:42 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-30 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-30 05:41:43 [auto1.de] INFO: Scrape type for SM64754: 0
2026-03-30 05:41:43 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-30 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-30 05:41:43 [auto1.de] INFO: Scrape type for PL66942: 0
2026-03-30 05:41:43 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-30 05:41:43 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-30 05:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:44 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for RU39212: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for ZS99681: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for EE75447: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for RP15985: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for SP96955: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for GS31332: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for TH39634: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for MY94359: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for ZS85048: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for ZY92659: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for DK37949: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for RF12873: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for XR35811: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for NC71734: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for JN07474: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for XZ21442: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for YE73742: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for CA87699: 0
2026-03-30 05:41:44 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-30 05:41:44 [auto1.de] INFO: Scrape type for XU33519: 0
2026-03-30 05:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:45 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for NK26673: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for NM76791: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for AU44008: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for UN89180: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for YH18669: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for KD63113: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for FL46038: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for NX82618: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for ZD28041: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for LK56613: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for KV17598: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for HX78633: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for GY83312: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for BG42804: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for HG43188: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for CW85183: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for KV68719: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for GJ18953: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for GR83992: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for BV89454: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for MX21840: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-30 05:41:45 [auto1.de] INFO: Scrape type for DR45963: 0
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-30 05:41:45 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-30 05:41:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:46 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-30 05:41:46 [auto1.de] INFO: Scrape type for RW68722: 0
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-30 05:41:46 [auto1.de] INFO: Scrape type for JX30830: 0
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-30 05:41:46 [auto1.de] INFO: Scrape type for EC85375: 0
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-30 05:41:46 [auto1.de] INFO: Scrape type for VX97978: 0
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-30 05:41:46 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-30 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for ED69500: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for AN99140: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for FD40697: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for UK28270: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for NY30954: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for UG29438: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for HH84481: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for NZ79152: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for KA54911: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for TV53465: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for UP69379: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for TP61394: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for BU21003: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for CG91765: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for NG66001: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for EA38947: 0
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-30 05:41:47 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-30 05:41:47 [auto1.de] INFO: Scrape type for HZ69536: 0
2026-03-30 05:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:48 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for TK93923: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for CS73315: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for SE41978: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for NS35557: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for LW95470: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for GY54695: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for TV85934: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for YN15081: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for PR24120: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for WB47522: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for JL46304: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for LL96634: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for HV52023: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for YT21216: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for EH91304: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for RR27166: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for SJ72548: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for SY42721: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for RM21545: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for UC78524: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for WG52031: 0
2026-03-30 05:41:48 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-30 05:41:48 [auto1.de] INFO: Scrape type for RY75144: 0
2026-03-30 05:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:49 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for BX11542: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for DN27813: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for HZ35402: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for WA51516: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for GA49917: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for CC10989: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for MP53713: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for YA63127: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for WK48382: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for AN23805: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for VL97674: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for UT78656: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for RT81127: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for KK21790: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-30 05:41:49 [auto1.de] INFO: Scrape type for TV45930: 0
2026-03-30 05:41:49 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for DZ20117: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for BR60141: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for YA36470: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for VR29597: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for LT01381: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for ZX19467: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for BC54503: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for YR75150: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for TP97389: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for EC10607: 0
2026-03-30 05:41:50 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-30 05:41:50 [auto1.de] INFO: Scrape type for LE99206: 0
2026-03-30 05:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:51 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for PH13735: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for CY46145: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for NC58057: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for TF03370: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for FF37262: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for UL28707: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for FR17679: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for XG50299: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for VR85555: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for VB32886: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for DC55349: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for HM04559: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for CE21106: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for BN42758: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for ZH67756: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for PN96283: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for KZ38664: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-30 05:41:51 [auto1.de] INFO: Scrape type for MF03624: 0
2026-03-30 05:41:51 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 05:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:52 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for EK32140: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for GE75594: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for BH61935: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for CV13370: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for GF54025: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for KK05104: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for DT00553: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for GM93554: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for KC33777: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for JD18961: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for EU91257: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for MJ24427: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for TY73105: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for ZC07667: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-30 05:41:52 [auto1.de] INFO: Scrape type for RY65257: 0
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 05:41:52 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for AN00284: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for XZ09557: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for PW75443: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for ZU51849: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for VS08295: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for DZ10370: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for LH85097: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for ZM06899: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for MW28967: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for ZB32219: 0
2026-03-30 05:41:53 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-30 05:41:53 [auto1.de] INFO: Scrape type for HL71303: 0
2026-03-30 05:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:54 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for HP58071: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for DZ90314: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for ZD05213: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for WC53392: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for SS01468: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for VU61436: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for YD79813: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for JR23306: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for YN71631: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for EM86154: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for SK06184: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for SZ07968: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for RT44513: 0
2026-03-30 05:41:54 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-30 05:41:54 [auto1.de] INFO: Scrape type for JB74543: 0
2026-03-30 05:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:55 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for HX73394: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for ES38254: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for PU69799: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for BM68891: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for AN35443: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for CP64572: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for CA31284: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for JE64211: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for RU51924: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for UM98970: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for PP81333: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for RS29828: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for WB65429: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for BV82977: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for ZV11386: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for FW24707: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for NE29415: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for LF31183: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for RU06209: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-30 05:41:55 [auto1.de] INFO: Scrape type for CN30644: 0
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-30 05:41:55 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-30 05:41:56 [auto1.de] INFO: Scrape type for PC42361: 0
2026-03-30 05:41:56 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-30 05:41:56 [auto1.de] INFO: Scrape type for ZD03679: 0
2026-03-30 05:41:56 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-30 05:41:56 [auto1.de] INFO: Scrape type for AJ68338: 0
2026-03-30 05:41:56 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-30 05:41:56 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-30 05:41:56 [auto1.de] INFO: Scrape type for XY91311: 0
2026-03-30 05:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:57 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for UJ32060: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for VX51529: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for ZX35580: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for MB10012: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for JB16135: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for WX88880: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for AL99999: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for LD20816: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for FR59515: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for PB68045: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for FK87134: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for AC64408: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for MS92853: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for KJ96076: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for US66744: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for GB90564: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for RL85498: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for NV50024: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for WB83413: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for NX27502: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for MF21991: 0
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 05:41:57 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-30 05:41:57 [auto1.de] INFO: Scrape type for XR92513: 0
2026-03-30 05:41:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:41:58 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6742 | hits on page: 40
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for GZ82101: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for FT59815: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for TN55271: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for ZA78506: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for XT20747: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for GF23268: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for YD01023: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for GJ73585: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for YC95910: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for HE47734: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for JR52179: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for LD23223: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for LM31898: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for HL01555: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for WJ67055: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for EJ09183: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for GZ17275: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for GY04691: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for WD20973: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for RN07993: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for EC99072: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for EN09392: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-30 05:41:58 [auto1.de] INFO: Scrape type for DT06996: 0
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 05:41:58 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-30 05:41:59 [auto1.de] INFO: Scrape type for DK35136: 0
2026-03-30 05:41:59 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-30 05:41:59 [auto1.de] INFO: Scrape type for WJ60429: 0
2026-03-30 05:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:00 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for RX22328: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for VE13678: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for FG48361: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for WM91088: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for CG06120: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for XX47236: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for AY24824: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for JR48888: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for WX17645: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for FP27721: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for KC60426: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for EL78604: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for KP52427: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for UZ60031: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-30 05:42:00 [auto1.de] INFO: Scrape type for YP26052: 0
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-30 05:42:00 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-30 05:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:01 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for UX04638: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for XT42092: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for ER27214: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for DU68074: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for ZN38550: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for TR40985: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for BW25069: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for UP55636: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for ZT83144: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for UY91981: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for VR01975: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for HL66974: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for CJ73141: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for LT88740: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for FE36611: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for ST78057: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for PV80087: 0
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-30 05:42:01 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-30 05:42:01 [auto1.de] INFO: Scrape type for KY32435: 0
2026-03-30 05:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:02 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for PY07739: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for DN86096: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for RV77607: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for UP26126: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for TV59519: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for AC34212: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for EW67018: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for AL30364: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for FW19107: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for SJ02125: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for VL24807: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for NF97550: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for ZA82087: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for PR51827: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-30 05:42:02 [auto1.de] INFO: Scrape type for KU26816: 0
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 05:42:02 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 05:42:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:03 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-30 05:42:03 [auto1.de] INFO: Scrape type for CM42106: 0
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-30 05:42:03 [auto1.de] INFO: Scrape type for UR14680: 0
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-30 05:42:03 [auto1.de] INFO: Scrape type for GZ33681: 0
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-30 05:42:03 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-30 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for XT67395: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for XT85364: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for KJ39198: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for EX55373: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for BN44220: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for KT60539: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for JM65569: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for LX23482: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for KC29293: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for HM10485: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for GZ74020: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for HZ02763: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for KZ16493: 0
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 05:42:04 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-30 05:42:04 [auto1.de] INFO: Scrape type for DF05561: 0
2026-03-30 05:42:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:05 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for GK39429: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for MV07839: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for AW19440: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for DG41556: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for HU15676: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for SV56483: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for ZM61762: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for LJ25581: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-30 05:42:05 [auto1.de] INFO: Scrape type for LL75700: 0
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 05:42:05 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for NG57043: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for XA48872: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for ZZ30319: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for FJ78997: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for SC04632: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for CA87929: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for GL40281: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for WC65602: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for HF13996: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for RX58241: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for VN03026: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for NS77188: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-30 05:42:06 [auto1.de] INFO: Scrape type for GT32005: 0
2026-03-30 05:42:06 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-30 05:42:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:06 [scrapy.extensions.logstats] INFO: Crawled 162 pages (at 26 pages/min), scraped 1021 items (at 65 items/min)
2026-03-30 05:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 157MiB
2026-03-30 05:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:07 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for SF89930: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for FF09080: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for JR73784: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for DT59270: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for AY51976: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for VZ43833: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for HA56884: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for FD80393: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for DA22909: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for BF10429: 0
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-30 05:42:07 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-30 05:42:07 [auto1.de] INFO: Scrape type for XY13632: 0
2026-03-30 05:42:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:08 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for TS47391: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for JD30879: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for ZF87196: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for DK10749: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for DD00982: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for JV93942: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for RR37288: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for XL20163: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for RW03523: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for ZY17523: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for GW53776: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for PH41345: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for FB79072: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for KW07987: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for HC06893: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for BM85402: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for CA67550: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 05:42:08 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-30 05:42:08 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-30 05:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:09 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:09 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 05:42:09 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-30 05:42:09 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-30 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-30 05:42:09 [auto1.de] INFO: Scrape type for PJ27517: 0
2026-03-30 05:42:09 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for RR83304: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for UE39516: 0
2026-03-30 05:42:10 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-30 05:42:10 [auto1.de] INFO: Scrape type for GM93366: 0
2026-03-30 05:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:11 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for VV13794: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for FH72870: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for GR32471: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for RV36249: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for TJ69669: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for CX33153: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for XL82798: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for DE88009: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for HF51839: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for KE20907: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for ZM57049: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for KW41122: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for EU16330: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for DR88922: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for SL55745: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for WA61115: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for SJ49235: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for BT33018: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-30 05:42:11 [auto1.de] INFO: Scrape type for KT95165: 0
2026-03-30 05:42:11 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-30 05:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:12 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:12 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for JX65004: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for VG77732: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for MW16405: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for BY24352: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for CN43056: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for SV90594: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for RA08562: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for EL77757: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for MZ03639: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for BS45971: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for NT95392: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for FB20065: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for YV73995: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for JX55294: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for BK93979: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for LC65511: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for NH74164: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for CG50140: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for YL16347: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for MN41763: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for SY55071: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for WT57840: 0
2026-03-30 05:42:13 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-30 05:42:13 [auto1.de] INFO: Scrape type for BZ34179: 0
2026-03-30 05:42:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:14 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for GZ42240: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for DZ63249: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for MN76950: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for KV46000: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for TA12646: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for VG58612: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for YC71395: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for SW39146: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for SS56268: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for HM38388: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for SA98041: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for HS55924: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for RM27503: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-30 05:42:14 [auto1.de] INFO: Scrape type for NU23342: 0
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 05:42:14 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 05:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:15 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:15 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for FL62048: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for MG84960: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for KU56806: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for ME28341: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for AU10222: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for MN75028: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for SB90605: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for HL93382: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for HU71027: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for HW93754: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for NB68023: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for BG93361: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for FT64289: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for KE10146: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for PN64243: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for WH57282: 0
2026-03-30 05:42:16 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-30 05:42:16 [auto1.de] INFO: Scrape type for SE82228: 0
2026-03-30 05:42:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:19 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for ZY49257: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for PG18082: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for VX47645: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for HE38410: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for YC00182: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for KZ11771: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for HJ16589: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for KM53361: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for PU74458: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for NK23311: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-30 05:42:19 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-30 05:42:19 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-30 05:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:20 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for SM71650: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for ZU52934: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for PW89679: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for GD61279: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for KU32415: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for NG84191: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for UX99567: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for SR86923: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for CZ39134: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for EU15499: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for HG48100: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for WA68058: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for RZ05971: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for VL73605: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for TZ58013: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 05:42:20 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-30 05:42:20 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-30 05:42:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:21 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 6742 | hits on page: 40
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for GR42785: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for MM73538: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for AH24505: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for RF00811: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for CA70430: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for AZ56926: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for GY33643: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for EK48004: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-30 05:42:21 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-30 05:42:21 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 05:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:22 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 6742 | hits on page: 22
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for SK64465: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-30 05:42:22 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-30 05:42:22 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-30 05:42:23 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-30 05:42:23 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 05:42:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 05:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 05:42:24 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 6742 | hits on page: 0
2026-03-30 05:42:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 05:42:24 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-30 05:42:24 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 575, <ScrapeType.BATCH_SKIPPED: 5>: 543}
2026-03-30 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774417344 HTTP/1.1" 200 None
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA56096') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AC12210') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD15134') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD23421') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AD30347') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE25088') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE57375') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE85506') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AF02624') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AF26526') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG47045') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG68245') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AG81908') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH08010') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH63822') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ36427') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ43835') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ48906') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ52886') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK29968') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL26370') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AL26390') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AM28112') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN58220') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN81666') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AP14606') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR20448') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR53397') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR92102') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS30012') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS76421') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT10820') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AT77734') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU54202') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU55617') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU59332') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AU81189') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV21750') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV39061') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV75064') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AV79027') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW46792') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW54407') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW60469') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX26003') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AY36056') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ47041') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA10815') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA27510') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA35030') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA69137') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BA69791') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BB01261') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BB28430') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC62172') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE15713') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BE42587') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF15053') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG55575') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG62989') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BH58234') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ47393') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ95668') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK02883') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK14360') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK19544') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK20786') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BK29075') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM03506') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM52071') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM68137') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BM81615') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BN56621') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP06971') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BP48380') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS69347') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS69433') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS82229') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BT68423') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BU08645') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV10946') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV26792') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV83004') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW15649') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW73100') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BW76516') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX01396') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX11667') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX30024') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BY60548') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ51824') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB02543') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC29969') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC88412') HTTP/1.1" 204 0
2026-03-30 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CC99014') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE00996') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE36552') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ05859') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ14635') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ71643') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CL74914') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CM08334') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CM17786') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CN77952') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP23655') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP43652') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CP72431') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR12764') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR22665') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CT97005') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU48100') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU61707') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CU99839') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CV37690') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CV53155') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW13033') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX10454') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ06704') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA01841') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA58372') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DA80798') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB61488') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DB97906') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC21362') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC31886') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD22409') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD28196') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DD79377') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE12895') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE58011') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DE89827') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF41364') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DF54938') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG39012') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG54182') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG89891') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH44741') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH50957') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH69075') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DH92407') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ83271') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK44337') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK94439') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL19979') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL55883') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL56327') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL67222') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL79544') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DL91999') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DM16906') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DN04917') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DP16554') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR13547') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS17671') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS50562') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS56876') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS58263') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS88458') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS95660') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT44035') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU13236') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DU42498') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV30592') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV60847') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV80392') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DV90877') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DW44746') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DX87949') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ58023') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ62505') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA41193') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA73737') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA80592') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EA84141') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB13613') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB52014') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC04901') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EC98575') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED11962') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED18071') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED27398') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE43916') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE61294') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EE92393') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EG83339') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EG90561') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH27268') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH84607') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ23476') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ73750') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ86040') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ88001') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ88742') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK52786') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK94658') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL22398') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM13687') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM44558') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM86962') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EN99647') HTTP/1.1" 204 0
2026-03-30 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EP15828') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ES41120') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EU83444') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EX37588') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EY40407') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ11573') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ22859') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ39820') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ42258') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FA12249') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FA12849') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FA20425') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB07600') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FD73520') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE30948') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FE68770') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF02125') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FF89334') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG03748') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG53115') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FG97056') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH04925') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FH45138') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ33102') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ70087') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ85096') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK17348') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK91409') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FK93293') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL73255') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FL82588') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM33897') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM70511') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FN15696') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP71680') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FR37566') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS71735') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT14366') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT45834') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT67181') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT86987') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT96427') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU03331') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU40878') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU61235') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FU73631') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW79268') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX63551') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA08810') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA37164') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA41838') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GA58306') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB03040') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GB62307') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD03210') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GD30190') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GE13571') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GF65888') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH31324') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH58491') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ11229') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ47175') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ47766') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK07258') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GK50867') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL13931') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL44291') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GL64665') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GM27951') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GM88826') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN47146') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GN88157') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GP33761') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR11501') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR41334') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GR45820') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS56582') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GS67672') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT23804') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT33778') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GT80933') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GU12506') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV13584') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GV67335') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW16115') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW86923') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX34656') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX59983') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY88055') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ19825') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ48761') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA80743') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA82421') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA88767') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HB92376') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC09994') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC27658') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC59748') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC88592') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD04913') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HD75815') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE07812') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HE23552') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HF52893') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HG04388') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HH77580') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ00196') HTTP/1.1" 204 0
2026-03-30 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ06967') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ89705') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM68746') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM81140') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HN64082') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HN90292') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HP94398') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS19061') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HS86172') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT12276') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT66718') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT83269') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU95609') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HV93150') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW25622') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW52746') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX19118') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX57134') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY42033') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HY83905') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ23857') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ41493') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ47442') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JA07971') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB45196') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JB78409') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JC81782') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD86609') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE05707') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JE19538') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JF72156') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG13784') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG19811') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG76289') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JH38778') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ03524') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JK00731') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JL18669') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JL21494') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JP84202') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JR02138') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JR44923') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JS22889') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JS95310') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JT23307') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JT51614') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU46897') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU62775') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JU71922') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV03502') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV28165') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV46676') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JV75054') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX31079') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JX76213') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JY64543') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB62051') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB77331') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC48076') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC79306') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC80450') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC84650') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE27636') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE28769') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE43336') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE72260') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE80429') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE92414') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KE98505') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KF82637') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KG12605') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KG38327') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KG48198') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KG83875') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH21389') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH58149') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KH75220') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ05705') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KK98013') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL25052') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL28349') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL46605') HTTP/1.1" 204 0
2026-03-30 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL47611') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL60388') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KL84142') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KM54733') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KN94561') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP74174') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS06619') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS59515') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU01647') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU35719') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU44125') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU57427') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU59014') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU73270') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KV63005') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KW64859') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KW88418') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX05007') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY23805') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ59840') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA22146') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA57217') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LA76342') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LB12780') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LB38166') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC64899') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC72082') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91351') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LC96578') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD47077') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD58443') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LD79008') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE02589') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE13134') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE20842') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE40523') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LE42510') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LF41724') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LF89859') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG13738') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG14495') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LH94842') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ05323') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ17276') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ71874') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK16139') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK68113') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK83355') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LL88843') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN08949') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN17413') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN31586') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN41500') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LN43699') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LP14148') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LP19893') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR11190') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS72961') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LS78180') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT05402') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LT32081') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LU04897') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW20626') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW60585') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW61046') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LW87234') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX18259') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LX36852') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY44533') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY65080') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY93113') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ30848') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ90334') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA49847') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MA94729') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MB78581') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MC28138') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MC91310') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME00457') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME03066') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME34815') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ME99792') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF91165') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF96537') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG25750') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG40460') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG52993') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH43288') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MH63708') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK03004') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK42660') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MK48701') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ML37870') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MM68366') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MP40073') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR90559') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS32358') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MS55622') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT45240') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT45375') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MT62692') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MU01104') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW77232') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MX60851') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MY14085') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ33381') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ43274') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ56747') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA45599') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA47397') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC00058') HTTP/1.1" 204 0
2026-03-30 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC81560') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND76762') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND80232') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND80771') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ND81475') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NE25161') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF08769') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF08927') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF25931') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NF89694') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NG11610') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NH99800') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ25089') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ85165') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NL57154') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NL99287') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NM73317') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NN55113') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NN89583') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35438') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS53263') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS67109') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NU29919') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NU52680') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NU71616') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NW79818') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NX49393') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NY47873') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ23379') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ58093') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ91799') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ99136') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA72548') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PB60520') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PB92861') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD89082') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PD91193') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE04106') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PE71422') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PG28684') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH12649') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH36679') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH38896') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH43262') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ20080') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ59592') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK15232') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK36782') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM06516') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM41449') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM48030') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM73676') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN01777') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN34644') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN85502') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PN90846') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PR93278') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PS09950') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT69387') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT78208') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PT90924') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PU15323') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PU92515') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV56148') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV68629') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PV69101') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW39799') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW61731') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PW80265') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PX28762') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PY21370') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PY25760') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PY42242') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ08765') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ27766') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ64645') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ89019') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA09189') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB42457') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB45502') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB79655') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD78335') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RE22139') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RF15792') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RG25593') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RG28997') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RH12473') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RH77334') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ56748') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RK38207') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RK70115') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL36454') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL45967') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL49459') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL51091') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL87480') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RL98194') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RM23545') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN36659') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN73570') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN97715') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP94124') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RR52412') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS56858') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS69412') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS78128') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RS85297') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RT87869') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU05210') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RU80356') HTTP/1.1" 204 0
2026-03-30 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV00245') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RV63045') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RW09510') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RW74261') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RX85922') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY06187') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY82331') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ43844') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ63617') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA10052') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SA86864') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB42661') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB58801') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB66191') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB93706') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SC64001') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SC86165') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF11828') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF54532') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF61721') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SF98154') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG15737') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG81361') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG90147') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SK01736') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SK47158') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL10309') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL47350') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL72515') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL93449') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SM41668') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SN60352') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SN65366') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SN86769') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR75413') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST40418') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST79322') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU01096') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV01291') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SV70598') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW16799') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW32156') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW58131') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW78634') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW79051') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX03745') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX16949') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX25717') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY32033') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY35646') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY47476') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ36384') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TA49782') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB53836') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TC07734') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TC28676') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TC87236') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TD31872') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF45402') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF74215') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF99658') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG07473') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG47618') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG87010') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG96271') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH19852') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TH36416') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ00459') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ22986') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ45185') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL20139') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL28255') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL77637') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL88198') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TL94146') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TN50478') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TP73493') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13013') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TS10259') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TS52413') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TT92316') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU72287') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TU81066') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV04886') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TW21901') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY83862') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ34129') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ94042') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB00091') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB27784') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB35723') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UB78248') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD42563') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD93866') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE33095') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF18936') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF70707') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UF81392') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG68676') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG76679') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UG76681') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UH50097') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ78099') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UK19359') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL11140') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UL97978') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM08847') HTTP/1.1" 204 0
2026-03-30 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UM49108') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UN04138') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UP10403') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR19937') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US50214') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='US86090') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UT19748') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UU72238') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV48701') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UV94550') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UW96350') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UX65351') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UX74890') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY37339') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UY55734') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VA36243') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VA97857') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC25753') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VC81085') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VD78699') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VF90788') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG75140') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ09220') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK12557') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VK79463') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL09458') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL24076') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VL87987') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VM35632') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VN24538') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP46996') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP51849') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VP80114') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR30420') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR40323') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR41513') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR47294') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR93366') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS37125') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS98058') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT24762') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT63321') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT86877') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VT96257') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VU31685') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV18496') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV62013') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV63290') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW06813') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW41338') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW56237') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VW99206') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VY45203') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ60551') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ70591') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ72237') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ85134') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ98388') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA19599') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA21484') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA77522') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WA88438') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB12329') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB29863') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WB37770') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC54239') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD68299') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WE71752') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WF62130') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WF89081') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG15729') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG93949') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH32885') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WH84365') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ28522') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ86551') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK40778') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WK88788') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM09377') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM17624') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WM40779') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WN46051') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WN64053') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WP16695') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR52599') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR54779') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WR64754') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS06409') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WS16596') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT85472') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WT89769') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU68281') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU90805') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU92658') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WU93233') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW12677') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW28326') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WW56943') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WX09976') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY23938') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WY64924') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ39940') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ43946') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA71760') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XA92831') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XB86551') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC07918') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC57574') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC74096') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD43594') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD45814') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XD98968') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE06482') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF16999') HTTP/1.1" 204 0
2026-03-30 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XF41707') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XH38683') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK59530') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XK68644') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL14264') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL17025') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL41881') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL59615') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL83626') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XM11080') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XN50029') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XN62597') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP40481') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP74375') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XR44422') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XS01809') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XS43987') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XS67666') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XT36518') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XT37024') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU21203') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XU97028') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW32746') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW33146') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XW54667') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX40624') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX60480') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XX78257') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XY94240') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ38274') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ92523') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA11397') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA54286') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YB13749') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YC51715') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YC70654') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YD35682') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE23327') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE28544') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF14420') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YF15103') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG36901') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG42249') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YG50429') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YH28789') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ29002') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ30757') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YK53649') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL08953') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL09839') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL24232') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL68032') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM49778') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YM93497') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YN29157') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YN42834') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YN83073') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YP84180') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YP98141') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR51097') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR81825') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YS79032') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT38203') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YT83773') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU75637') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YU86925') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YW53245') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YX30528') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY59488') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YY69015') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ27175') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ29013') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ32974') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ92521') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ96927') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA26238') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC72155') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD31462') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD72487') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD87629') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE01184') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE15783') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF13011') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF96095') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG27300') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG28788') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG67358') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH43286') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH83700') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ72722') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ77859') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK56159') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL40027') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL67670') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL94803') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM00334') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM27094') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM29811') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP60206') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS07657') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT48706') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT67955') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU47815') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV19149') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV60213') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV62579') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW37388') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW71788') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW79843') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY14435') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY21703') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY99133') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ03958') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ14485') HTTP/1.1" 204 0
2026-03-30 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ37198') HTTP/1.1" 204 0
2026-03-30 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ62600') HTTP/1.1" 204 0
2026-03-30 05:42:34 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1021 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-30T05_30_00.jl
2026-03-30 05:42:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 506171,
 'downloader/request_count': 174,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 172,
 'downloader/response_bytes': 29213389,
 'downloader/response_count': 174,
 'downloader/response_status_count/200': 174,
 'elapsed_time_seconds': 747.362631,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 5, 42, 34, 5269, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1021,
 'log_count/DEBUG': 15259,
 'log_count/INFO': 18581,
 'memusage/max': 165130240,
 'memusage/startup': 148389888,
 'request_depth_max': 173,
 'response_received_count': 174,
 'scheduler/dequeued': 174,
 'scheduler/dequeued/memory': 174,
 'scheduler/enqueued': 174,
 'scheduler/enqueued/memory': 174,
 'scrape_type/batch_skipped': 3407,
 'scrape_type/price_update': 1021,
 'scrape_type/skipped': 2354,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 174,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.2951621136189178,
 'scrapy-zyte-api/mean_response_seconds': 3.390287081132931,
 'scrapy-zyte-api/processed': 174,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 174,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 173,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 174,
 'scrapy-zyte-api/request_args/httpRequestBody': 172,
 'scrapy-zyte-api/request_args/httpRequestMethod': 172,
 'scrapy-zyte-api/request_args/httpResponseBody': 174,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 174,
 'scrapy-zyte-api/request_args/sessionContext': 174,
 'scrapy-zyte-api/request_args/url': 174,
 'scrapy-zyte-api/status_codes/200': 174,
 'scrapy-zyte-api/success': 174,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 6782,
 'source/total_available': 6742,
 'start_time': datetime.datetime(2026, 3, 30, 5, 30, 6, 642638, tzinfo=datetime.timezone.utc)}
2026-03-30 05:42:34 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 05:42:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f02838d6410>
2026-03-30 05:42:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f02836a0350>